-- Logs begin at Sat 2022-10-15 08:06:22 UTC, end at Sat 2022-10-15 09:34:13 UTC. -- Oct 15 08:36:00.783332 dv-cinder-856971-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 08:36:00.791749 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 15 08:36:00 2022] *** Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: nodename: dv-cinder-856971-3-iscsi Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: machine: x86_64 Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: clock source: unix Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: pcre jit disabled Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: detected number of CPU cores: 4 Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: current working directory: / Oct 15 08:36:00.793709 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: detected binary path: /usr/bin/uwsgi-core Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: your processes number limit is 47680 Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: your memory page size is 4096 bytes Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: detected max file descriptor number: 2048 Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: lock engine: pthread robust mutexes Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: thunder lock: enabled Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 08:36:00.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 15 08:36:00.834696 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: Python main interpreter initialized at 0x5640c007a9c0 Oct 15 08:36:00.834696 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: python threads support enabled Oct 15 08:36:00.834696 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: your server socket listen backlog is limited to 100 connections Oct 15 08:36:00.834696 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: your mercy for graceful operations on workers is 90 seconds Oct 15 08:36:00.835124 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 08:36:00.835124 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: *** Operational MODE: preforking *** Oct 15 08:36:00.835355 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: *** uWSGI is running in multiple interpreter mode *** Oct 15 08:36:00.835355 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: spawned uWSGI master process (pid: 110338) Oct 15 08:36:00.835541 dv-cinder-856971-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 08:36:00.841219 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: spawned uWSGI worker 1 (pid: 110339, cores: 1) Oct 15 08:36:00.841219 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: spawned uWSGI worker 2 (pid: 110340, cores: 1) Oct 15 08:36:00.841219 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 08:36:01.489073 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 08:36:01.492089 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 08:36:02.562485 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:36:02.562485 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: from cryptography.utils import int_from_bytes Oct 15 08:36:02.563104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:36:02.563104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: from cryptography.utils import int_from_bytes Oct 15 08:36:02.564810 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:36:02.564810 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: from cryptography.utils import int_from_bytes Oct 15 08:36:02.565240 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:36:02.565240 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: from cryptography.utils import int_from_bytes Oct 15 08:36:05.016742 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 08:36:05.017312 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 08:36:05.017504 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 08:36:05.017893 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 08:36:05.018147 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 08:36:05.018530 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.018852 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.019176 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.019264 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 08:36:05.019611 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 08:36:05.019743 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.019897 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.019997 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 08:36:05.020207 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.020358 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 08:36:05.020522 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.020860 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 08:36:05.021094 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.021243 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.021419 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.021572 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.021698 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.021924 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022070 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022247 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022340 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-3-iscsi {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022579 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022682 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022894 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.022982 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023208 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023292 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023523 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023609 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023827 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.023915 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024100 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024228 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024418 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024554 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024751 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-3-iscsi {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.024909 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025066 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025353 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025481 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025667 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025779 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.025991 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026087 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026298 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026419 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026618 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026715 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.026925 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027016 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027242 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027424 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027548 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027736 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.027870 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028045 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028177 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028359 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028580 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-3-iscsi {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028698 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.028896 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029012 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029208 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029324 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029516 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029647 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.029949 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030039 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030262 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030360 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030566 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030653 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030883 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.030980 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-3-iscsi {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031204 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031310 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031509 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031597 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031832 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.031918 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032150 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032281 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032465 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032594 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032780 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.032921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033081 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033230 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033386 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033557 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033705 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.033893 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034034 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034225 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034331 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034546 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034645 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034855 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.034943 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.035160 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.035257 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.035992 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036157 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036307 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036404 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036618 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036706 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036890 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.036985 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037140 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037228 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037458 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037553 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037785 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.037889 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038093 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038192 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038399 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038487 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038708 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.038803 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039020 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039106 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039271 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039357 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039524 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039620 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039845 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.039942 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040166 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040268 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040479 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040587 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040788 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.040875 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041097 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041264 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041401 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041488 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041728 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.041819 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042042 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042142 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042351 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042438 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042652 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042738 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.042970 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043065 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043284 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043375 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043585 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043683 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043900 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.043996 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044217 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044364 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044518 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044605 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044822 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.044918 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045128 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045213 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045444 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045530 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045797 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.045889 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046102 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046188 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046350 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046449 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046648 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046736 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.046951 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047039 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047266 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047360 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047569 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047664 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047872 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.047958 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048175 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048275 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048472 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048558 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048764 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.048851 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049070 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049166 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049372 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049464 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049690 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.049792 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050002 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050109 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050306 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050393 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050609 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050708 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.050932 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.051612 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.051806 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.051955 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052112 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052252 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052418 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052584 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052736 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.052835 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053023 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053118 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053323 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053412 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053625 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.053951 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054040 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054262 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054359 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054563 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054664 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054865 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.054952 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055183 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055270 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055486 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055575 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055787 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.055881 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056188 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056398 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056491 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056704 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.056795 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057010 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057097 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057305 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057609 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057732 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.057945 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058040 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058250 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058335 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058551 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058646 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058852 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.058947 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059155 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059256 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059455 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059543 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059754 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.059841 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060052 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060138 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060351 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060446 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060653 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060765 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.060960 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061053 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061268 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061376 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061570 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061668 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061896 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.061988 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062321 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062501 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062605 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062805 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.062896 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.063108 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.063209 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.063428 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.063520 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.063756 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.063855 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.064068 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.064160 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.064380 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.064498 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.064687 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.064780 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.064993 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.065091 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:36:05.065305 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.065397 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.065627 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.065742 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.065959 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066051 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066264 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066366 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066615 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066725 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.066935 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067034 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067253 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067343 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067578 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067683 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067892 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.067983 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068203 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068316 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068517 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068619 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068821 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.068912 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069134 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069224 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069453 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069552 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069788 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.069881 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070099 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070191 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070424 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070527 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070742 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.070835 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.071057 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.071205 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.071382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.071692 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.071783 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072001 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072102 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072307 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072406 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072610 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072702 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.072943 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073033 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073249 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073348 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073556 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073648 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073893 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.073985 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074200 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074305 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074517 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074610 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074825 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.074917 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075131 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075232 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075438 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075530 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075744 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.075836 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076049 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076150 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076376 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076469 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076686 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.076787 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077000 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077310 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077411 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077618 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077733 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.077957 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078049 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078263 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078353 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078570 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078663 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078878 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.078968 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079177 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079267 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079477 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079569 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079777 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.079869 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080082 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080174 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080381 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080482 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080695 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.080787 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081016 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081110 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081319 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081420 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081629 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081759 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.081957 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082049 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082290 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082393 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082600 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082693 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082903 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.082994 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083207 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083311 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083511 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083609 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083816 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.083908 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084115 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084222 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084435 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084527 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084742 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.084834 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085043 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085135 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085355 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085445 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085653 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085800 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.085978 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086088 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086289 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086389 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086615 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086755 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086903 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.086992 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087209 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087299 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087514 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087609 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087824 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.087912 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088129 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088223 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088436 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088537 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088742 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.088829 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089058 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089144 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089369 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089466 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089706 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.089808 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090022 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090110 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090331 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090495 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090632 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090719 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.090939 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091038 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091241 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091329 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091538 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091634 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091836 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.091922 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092139 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092234 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092437 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092565 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092735 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.092831 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093033 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093122 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093333 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093418 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093637 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093799 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.093967 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094056 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094268 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094362 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094565 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094656 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094867 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.094973 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095165 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095266 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095494 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095595 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095793 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.095883 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096096 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096196 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096402 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096504 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096740 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.096847 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097035 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097136 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097338 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097439 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097641 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.097748 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.098484 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.098581 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.098798 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.098913 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099108 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099196 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099417 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099511 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099735 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.099822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100043 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100129 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100359 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100446 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100665 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100752 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.100983 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101130 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101289 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101602 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101712 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.101928 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102030 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102241 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102327 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102561 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102698 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102875 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.102962 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103188 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103283 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103502 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103597 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103805 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.103898 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104114 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104211 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104419 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104506 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104723 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.104810 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105031 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105144 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105333 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105420 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105645 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105763 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.105970 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106066 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106284 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106371 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106590 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106676 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.106909 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107017 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107211 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107299 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107525 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107612 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107824 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.107913 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108134 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108227 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108453 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108547 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108763 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.108852 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109075 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109179 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109384 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109486 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109713 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.109803 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110024 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110111 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110329 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110416 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110634 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110723 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.110934 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111021 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111234 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111333 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111538 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111638 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111847 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.111949 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112150 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112246 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112455 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112543 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112754 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.112858 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113065 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113162 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113372 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113510 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113757 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.113846 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114066 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114377 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114464 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114693 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.114780 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115002 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115146 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115319 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115406 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115624 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115723 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.115926 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116013 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116227 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116314 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116534 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116620 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116837 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.116950 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117142 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117232 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117443 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117531 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117766 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.117857 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118103 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118200 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118408 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118504 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118709 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.118797 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119019 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119334 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119430 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119640 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119727 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.119946 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120032 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120251 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120428 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120557 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120644 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120871 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.120959 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121179 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121276 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121486 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121572 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121814 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.121904 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122122 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122212 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122430 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122517 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122737 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.122888 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123049 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123127 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123350 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123425 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123658 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123744 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.123965 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124096 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124266 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124353 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124572 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124659 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124883 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.124977 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.125203 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.125442 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.125528 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.125800 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.125891 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126115 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126202 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126431 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126517 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126752 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.126848 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127060 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127201 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127375 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127463 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127696 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.127793 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128006 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128259 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128349 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128595 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128681 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.128914 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.129532 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.129782 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.129958 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130105 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130252 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130426 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130597 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130745 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.130892 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131036 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131191 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131339 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131494 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131632 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131773 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.131917 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132058 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132355 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132498 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132640 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132776 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.132917 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133059 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133216 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133364 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133491 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133577 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133777 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.133926 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134093 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134282 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134448 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134610 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134768 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134882 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.134972 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135157 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135285 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135496 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135585 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135798 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.135886 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136131 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136271 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136455 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136553 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136794 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.136881 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137098 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137185 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137403 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137507 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137723 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.137814 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138032 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138118 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138331 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138431 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138632 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138719 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.138944 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139030 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139248 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139345 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139548 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139637 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139856 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.139954 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140163 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140252 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140469 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140556 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140773 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.140861 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141073 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141169 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141378 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141524 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141687 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.141777 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142008 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142104 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142312 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142399 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142612 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142698 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.142911 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143045 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143218 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143314 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143522 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143620 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143822 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.143909 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144127 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144213 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144429 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144594 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144797 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.144887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.145116 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.145202 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.145419 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.145526 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.145999 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146090 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146316 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146403 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146628 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146734 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.146932 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147020 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147243 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147375 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147548 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147637 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147850 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.147938 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148150 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148236 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148453 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148551 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148749 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.148836 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149054 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149140 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149359 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149447 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149663 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149768 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.149996 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150083 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150298 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150394 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150602 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150697 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150903 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.150999 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151205 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151292 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151504 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151590 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151808 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.151902 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152105 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152192 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152403 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152514 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152700 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.152839 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153001 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153145 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153299 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153456 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153615 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153789 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.153942 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154099 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154242 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154406 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154542 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154716 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.154839 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155028 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155175 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155334 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155475 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155638 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155826 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.155946 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156127 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156253 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156435 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156580 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156750 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.156890 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157057 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157196 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157364 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157495 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157671 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.157947 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158037 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158283 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158371 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158589 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158676 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158904 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.158991 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159207 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159296 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159506 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159593 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159825 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.159912 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.160131 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.160220 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.160972 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161060 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161291 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161386 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161601 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161708 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.161940 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162030 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162245 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162334 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162552 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162648 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162861 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.162948 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163165 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163261 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163473 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163560 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163780 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.163867 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164087 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164183 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164396 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164530 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164703 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.164790 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165009 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165109 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165314 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165402 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165615 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165737 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.165947 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166048 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166252 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166341 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166554 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166641 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166870 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.166958 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167173 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167259 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167474 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167606 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167781 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.167870 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168084 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168391 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168484 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168693 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.168781 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169003 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169117 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169316 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169626 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169749 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.169991 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170080 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170306 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170403 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170615 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170713 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.170929 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171016 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171237 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171336 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171536 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171623 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171846 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.171953 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172267 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172362 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172577 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172672 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172886 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.172973 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173189 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173289 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173493 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173589 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173822 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.173912 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174145 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174237 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174448 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174532 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174752 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.174838 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175053 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175176 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175373 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175493 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175673 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.175805 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176088 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176181 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176462 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176549 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176772 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.176858 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177085 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177175 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177411 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177498 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177741 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.177858 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178051 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178140 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178358 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178452 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178681 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178777 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.178987 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179075 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179310 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179398 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179632 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179748 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.179938 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180036 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180257 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180345 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180575 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180723 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.180885 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181038 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181197 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181351 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181499 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181724 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.181844 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182025 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182165 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182352 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182476 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182661 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182794 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.182980 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183202 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183338 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183521 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183618 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183828 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.183917 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184145 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184232 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184465 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184553 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184785 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.184884 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185069 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185157 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185377 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185474 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185695 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.185787 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186001 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186089 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186320 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186500 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186622 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186826 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.186925 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187141 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187229 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187466 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187555 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187794 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.187882 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188092 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188179 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188400 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188488 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188698 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.188793 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189009 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189099 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189319 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189415 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189635 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189740 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.189974 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190073 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190277 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190365 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190590 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190676 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190894 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.190989 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.191198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.191286 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.191515 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192099 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192332 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192428 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192645 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192732 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.192963 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193049 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193279 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193420 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193602 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193724 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.193951 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194051 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194259 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194348 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194587 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194674 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194901 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.194993 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195214 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195302 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195520 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195607 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195826 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.195958 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196143 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196231 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196445 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196532 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196746 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.196840 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197052 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197141 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197353 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197447 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197654 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197814 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.197973 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198069 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198277 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198365 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198578 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198683 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198882 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.198971 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199181 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199290 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199499 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199618 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199798 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.199926 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200115 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200233 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200419 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200547 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200719 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.200855 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201019 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201163 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201316 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201470 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201651 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201806 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.201971 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202114 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202293 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202421 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202597 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202727 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.202913 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203055 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203225 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203362 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203535 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203688 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.203846 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204000 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204157 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204308 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204466 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204615 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204776 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.204914 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205086 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205261 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205393 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205569 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205726 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.205925 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206041 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206239 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206355 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206565 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206871 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.206968 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.207238 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.207328 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.207565 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.207652 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.207885 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208026 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208193 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208281 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208506 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208594 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208820 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.208921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209129 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209217 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209438 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209526 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209773 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.209866 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210082 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210410 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210603 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210729 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.210939 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211049 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211258 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211380 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211577 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211695 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211896 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.211992 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212218 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212305 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212536 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212626 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212853 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.212948 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213269 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213484 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213579 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213821 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.213925 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214151 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214319 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214461 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214550 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214770 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.214858 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215077 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215178 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215385 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215480 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215694 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.215790 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216000 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216102 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216306 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216401 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216613 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216700 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.216962 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217051 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217283 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217379 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217600 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217737 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.217940 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218066 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218249 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218349 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218655 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218870 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.218958 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.219186 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.219382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.219503 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.219691 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.219828 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220019 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220107 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220340 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220429 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220659 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220748 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.220969 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221057 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221283 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221378 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221602 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221710 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.221927 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222016 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222227 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222326 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222534 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222675 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.222889 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223123 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223213 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223444 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223540 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223783 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.223871 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224080 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224175 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224393 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224482 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224698 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.224785 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225040 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225221 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225371 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225560 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225705 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.225895 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226014 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226215 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226311 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226533 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226621 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226846 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.226933 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227147 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227235 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227462 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227559 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227765 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.227865 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228064 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228196 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228375 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228471 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228681 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.228939 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229028 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229273 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229370 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229576 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229664 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.229903 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230003 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230203 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230290 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230507 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230594 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230806 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.230901 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231127 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231221 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231529 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231728 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.231816 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232027 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232122 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232335 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232431 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232633 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232721 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.232931 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233018 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233230 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233326 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233529 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233618 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233857 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.233946 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234157 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234257 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234462 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234556 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.234846 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235065 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235153 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235385 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235479 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235693 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235781 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.235989 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236084 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236302 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236389 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236598 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236693 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236896 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.236984 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237199 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237285 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237502 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237589 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237833 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.237924 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.238141 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.238236 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.238973 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239071 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239290 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239386 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239622 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239710 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.239944 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240152 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240242 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240486 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240574 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240807 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.240894 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241140 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241228 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241455 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241541 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241789 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.241879 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242097 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242186 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242400 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242487 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242715 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.242804 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243021 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243111 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243332 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243420 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243639 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243882 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.243981 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244219 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244307 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244533 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244620 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244840 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.244977 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245147 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245234 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245452 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245538 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245781 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.245871 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246087 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246175 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246391 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246536 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246696 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246785 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.246999 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247086 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247309 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247448 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247618 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247706 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.247931 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248018 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248245 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248386 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248546 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248633 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248855 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.248942 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249165 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249253 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249470 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249557 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249801 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.249892 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250107 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250197 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250415 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250503 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250726 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.250813 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251033 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251121 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251332 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251428 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251681 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.251984 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252080 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252298 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252398 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252614 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252701 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.252927 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253016 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253233 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253321 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253553 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253641 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253896 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.253985 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.254296 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.254459 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.254615 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.254775 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.254925 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.255076 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.255236 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.255382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.255600 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.255901 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256008 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256218 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256306 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256539 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256685 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256816 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.256906 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257118 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257205 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257425 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257521 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257764 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.257856 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258072 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258160 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258372 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258515 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258672 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258776 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.258983 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259077 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259283 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259381 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259585 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259703 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.259885 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260033 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260185 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260346 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260489 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260654 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260788 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.260963 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261087 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261275 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261385 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261595 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261757 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.261933 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262034 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262241 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262336 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262635 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262853 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.262953 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263155 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263243 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263452 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263752 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.263848 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264051 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264139 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264359 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264445 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264666 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264755 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.264973 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265060 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265285 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265373 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265590 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265709 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.265922 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266010 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266226 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266312 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266534 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266636 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.266899 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267000 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267153 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267296 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267460 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267597 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267788 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.267903 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268097 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268193 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268406 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268532 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268716 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.268867 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.269030 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.269185 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.269338 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.269511 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.270181 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.270370 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.270519 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.270949 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271098 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271263 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271405 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271588 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271729 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.271914 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272045 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272233 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272364 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272679 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272883 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.272991 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273196 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273318 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273511 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273694 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273854 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.273942 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274258 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274483 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274581 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274799 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.274887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275130 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275216 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275439 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275529 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275749 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.275847 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276060 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276148 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276373 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276462 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276694 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.276782 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277015 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277114 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277320 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277409 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277643 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277759 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.277982 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278081 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278299 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278387 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278613 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278701 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.278928 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279025 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279243 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279331 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279562 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279647 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279869 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.279965 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.280171 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.280266 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.280411 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110339) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 08:36:05.280498 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.280792 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.281120 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.281447 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.281786 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.282113 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.282440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.282790 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.283108 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.283453 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.283785 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.284103 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.284417 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.284728 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:36:05.284974 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 08:36:05.433794 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO dbcounter [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Registered counter for database nova_api Oct 15 08:36:05.438074 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO dbcounter [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Registered counter for database nova_api Oct 15 08:36:05.455050 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.458185 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.462190 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writer thread running {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.464581 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writer thread running {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.517639 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.context [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0b25d10-5217-4459-9654-b7e7b9f4e0c0(cell1) {{(pid=110339) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 08:36:05.521116 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.context [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0b25d10-5217-4459-9654-b7e7b9f4e0c0(cell1) {{(pid=110340) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 08:36:05.522274 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:36:05.522741 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:36:05.524275 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:36:05.524934 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:36:05.525028 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:36:05.525410 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:36:05.525512 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:36:05.527001 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:36:05.527395 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_concurrency.lockutils [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110339) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:36:05.527729 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:36:05.528175 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:36:05.529346 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO dbcounter [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Registered counter for database nova_cell0 Oct 15 08:36:05.530197 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:36:05.532246 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO dbcounter [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Registered counter for database nova_cell0 Oct 15 08:36:05.533296 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO dbcounter [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Registered counter for database nova_cell1 Oct 15 08:36:05.536400 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO dbcounter [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Registered counter for database nova_cell1 Oct 15 08:36:05.541388 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.542398 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.544475 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.546671 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.549168 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writer thread running {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.550643 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writer thread running {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.551699 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writer thread running {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.557582 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writer thread running {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.696302 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO dbcounter [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Registered counter for database nova_cell0 Oct 15 08:36:05.702295 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO dbcounter [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Registered counter for database nova_cell0 Oct 15 08:36:05.703284 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110339) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.708328 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writer thread running {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:05.709539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_db.sqlalchemy.engines [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:36:05.714252 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writer thread running {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:36:06.050809 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: WARNING keystonemiddleware.auth_token [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:36:06.052650 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: WARNING keystonemiddleware.auth_token [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:36:06.059058 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: WARNING keystonemiddleware.auth_token [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:36:06.060004 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: WARNING keystonemiddleware.auth_token [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:36:06.402010 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: WARNING keystonemiddleware.auth_token [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:36:06.402937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: WARNING keystonemiddleware.auth_token [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:36:06.407948 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: WARNING keystonemiddleware.auth_token [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:36:06.408849 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: WARNING keystonemiddleware.auth_token [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:36:06.413276 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640c007a9c0 pid: 110339 (default app) Oct 15 08:36:06.414141 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5640c007a9c0 pid: 110340 (default app) Oct 15 08:36:06.415394 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:36:06.416565 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-c8fba58a-ddbe-4da1-be96-0952e5622584 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001738 Oct 15 08:36:06.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Sat Oct 15 08:36:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:26.840895 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:26.842201 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002064 Oct 15 08:37:26.842611 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 1/2] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:26.854310 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_api:SELECT=3 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:26.855238 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_cell0:SELECT=3 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:26.857772 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_cell1:SELECT=3 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:26.858627 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:27.752145 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-ef13fe55-7160-4c75-a818-ca108b242c5e admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:27.787120 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-ef13fe55-7160-4c75-a818-ca108b242c5e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.937865 Oct 15 08:37:27.787854 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 2/3] 10.222.0.30 () {60 vars in 1292 bytes} [Sat Oct 15 08:37:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:30.418343 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:30.419362 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-d5b60ad7-b0de-469e-af93-df5dc50f83e8 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 15 08:37:30.419916 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 2/4] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:30.857068 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-6434adfe-9a32-4e74-a590-64f6f9007f5c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "c1"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:30.904249 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-6434adfe-9a32-4e74-a590-64f6f9007f5c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.478408 Oct 15 08:37:30.905006 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 3/5] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:30.918513 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_api:SELECT=3 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:30.919316 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_cell0:SELECT=3 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:30.921262 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_cell1:SELECT=3 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:30.922005 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:31.127961 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-ad90c3c4-d435-4f0f-adad-c12e4c805cef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:31.196363 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-ad90c3c4-d435-4f0f-adad-c12e4c805cef admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.283072 Oct 15 08:37:31.196945 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 3/6] 10.222.0.30 () {64 vars in 1336 bytes} [Sat Oct 15 08:37:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:37:33.789629 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-6434adfe-9a32-4e74-a590-64f6f9007f5c admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:33.790677 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-6434adfe-9a32-4e74-a590-64f6f9007f5c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Oct 15 08:37:33.791079 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 4/7] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:34.456250 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-36419aff-5525-457b-98c9-5dc3290d8049 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "vcpus": 1, "swap": 0, "disk": 5}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:34.496084 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-36419aff-5525-457b-98c9-5dc3290d8049 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.698926 Oct 15 08:37:34.497726 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 4/8] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:34.509919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-36f70a78-fda7-4c48-a355-877ca914a1c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:34.551265 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-36f70a78-fda7-4c48-a355-877ca914a1c4 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045195 Oct 15 08:37:34.551983 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 5/9] 10.222.0.30 () {64 vars in 1336 bytes} [Sat Oct 15 08:37:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:37.155529 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-36419aff-5525-457b-98c9-5dc3290d8049 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:37.156544 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-36419aff-5525-457b-98c9-5dc3290d8049 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 15 08:37:37.157129 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 5/10] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:37.569627 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-ecbd7699-6681-45ad-89c2-02bf603f4e4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:37.589280 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-ecbd7699-6681-45ad-89c2-02bf603f4e4e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425024 Oct 15 08:37:37.590058 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 6/11] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:37.602850 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-2d30f33f-71dd-4c1e-88ef-a6f3f3394dc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:37.633122 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-2d30f33f-71dd-4c1e-88ef-a6f3f3394dc1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034187 Oct 15 08:37:37.633931 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 6/12] 10.222.0.30 () {64 vars in 1336 bytes} [Sat Oct 15 08:37:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:40.261127 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-ecbd7699-6681-45ad-89c2-02bf603f4e4e admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:40.262181 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-ecbd7699-6681-45ad-89c2-02bf603f4e4e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Oct 15 08:37:40.262582 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 7/13] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:40.684988 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-0ffe5c1a-0de1-4af8-b002-ca32347da8e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "ram": 2048, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:40.704892 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-0ffe5c1a-0de1-4af8-b002-ca32347da8e0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.435807 Oct 15 08:37:40.705546 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 7/14] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:40.718088 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-2bc2e9d7-6af1-4526-9ed3-baa2962d8002 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:40.746172 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-2bc2e9d7-6af1-4526-9ed3-baa2962d8002 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031798 Oct 15 08:37:40.747002 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 8/15] 10.222.0.30 () {64 vars in 1336 bytes} [Sat Oct 15 08:37:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:43.376402 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-0ffe5c1a-0de1-4af8-b002-ca32347da8e0 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:43.377373 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-0ffe5c1a-0de1-4af8-b002-ca32347da8e0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Oct 15 08:37:43.378337 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 8/16] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:43.821156 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:43.844502 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459458 Oct 15 08:37:43.845274 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 9/17] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:43.857671 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-a65d8cba-691b-4fb3-aa89-aa6f82508c37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:43.883526 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-a65d8cba-691b-4fb3-aa89-aa6f82508c37 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029689 Oct 15 08:37:43.884123 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 9/18] 10.222.0.30 () {64 vars in 1336 bytes} [Sat Oct 15 08:37:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:37:46.584493 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:46.585529 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Oct 15 08:37:46.586020 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 10/19] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:47.017364 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-bfff81eb-866e-4408-b578-f6ec2d06d3d6 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:47.043423 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-bfff81eb-866e-4408-b578-f6ec2d06d3d6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.451041 Oct 15 08:37:47.043864 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 10/20] 10.222.0.30 () {60 vars in 1292 bytes} [Sat Oct 15 08:37:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:37:49.720777 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:49.722163 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-6a2af501-3912-4c08-92a2-cc39962c4afb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Oct 15 08:37:49.722720 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 11/21] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:50.156903 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-5314288d-6e71-4d39-a580-fc8cc110a9ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "name": "m1.tiny", "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:50.180543 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-5314288d-6e71-4d39-a580-fc8cc110a9ca admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450248 Oct 15 08:37:50.181112 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 11/22] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 08:37:50.193415 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-a4459eaf-8677-4a51-9535-3e05be3713b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:50.224186 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-a4459eaf-8677-4a51-9535-3e05be3713b2 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034488 Oct 15 08:37:50.224949 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 12/23] 10.222.0.30 () {64 vars in 1333 bytes} [Sat Oct 15 08:37:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:52.886922 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-5314288d-6e71-4d39-a580-fc8cc110a9ca admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:52.887924 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-5314288d-6e71-4d39-a580-fc8cc110a9ca admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 15 08:37:52.888321 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 12/24] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:53.278814 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-b79c1c96-8e1a-43ed-88bc-753938097280 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "disk": 20, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:53.298154 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-b79c1c96-8e1a-43ed-88bc-753938097280 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.402434 Oct 15 08:37:53.298747 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 13/25] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:53.311741 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-35f07d04-bc53-4be1-aef7-70b34a1aaceb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:53.336492 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-35f07d04-bc53-4be1-aef7-70b34a1aaceb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028551 Oct 15 08:37:53.337117 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 13/26] 10.222.0.30 () {64 vars in 1333 bytes} [Sat Oct 15 08:37:53 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:37:55.981855 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-b79c1c96-8e1a-43ed-88bc-753938097280 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:55.982780 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-b79c1c96-8e1a-43ed-88bc-753938097280 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 15 08:37:55.983185 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 14/27] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:56.464456 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-5bc19db8-3d44-4972-9c13-44db8da89068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "swap": 0}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:56.488662 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-5bc19db8-3d44-4972-9c13-44db8da89068 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.498856 Oct 15 08:37:56.489879 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 14/28] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:56.502365 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-41bd9bb1-9999-431a-b1a9-cfcdf0de493b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:56.537670 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-41bd9bb1-9999-431a-b1a9-cfcdf0de493b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039404 Oct 15 08:37:56.538528 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 15/29] 10.222.0.30 () {64 vars in 1333 bytes} [Sat Oct 15 08:37:56 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:37:59.177715 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-5bc19db8-3d44-4972-9c13-44db8da89068 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:37:59.178825 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-5bc19db8-3d44-4972-9c13-44db8da89068 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 15 08:37:59.179305 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 15/30] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:37:59.615421 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-ef096a18-a4dd-4be6-88f8-4a35e4efc541 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "vcpus": 4, "ram": 8192, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:59.622316 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:37:59.634482 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-ef096a18-a4dd-4be6-88f8-4a35e4efc541 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.448844 Oct 15 08:37:59.635063 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 16/31] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:37:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:37:59.647002 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-4a519e74-ee6c-4706-82d2-b2be061f3a31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:37:59.674889 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-4a519e74-ee6c-4706-82d2-b2be061f3a31 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031345 Oct 15 08:37:59.675738 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 16/32] 10.222.0.30 () {64 vars in 1333 bytes} [Sat Oct 15 08:37:59 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:38:02.283223 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-ef096a18-a4dd-4be6-88f8-4a35e4efc541 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:02.284776 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-ef096a18-a4dd-4be6-88f8-4a35e4efc541 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Oct 15 08:38:02.285169 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 17/33] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:02.718073 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:02.725779 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:38:02.742747 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.451256 Oct 15 08:38:02.743320 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 17/34] 10.222.0.30 () {64 vars in 1283 bytes} [Sat Oct 15 08:38:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:38:02.756337 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-52539020-73ff-45d0-b3ca-97046d230ba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:02.781415 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-52539020-73ff-45d0-b3ca-97046d230ba1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029876 Oct 15 08:38:02.797714 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 18/35] 10.222.0.30 () {64 vars in 1333 bytes} [Sat Oct 15 08:38:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:38:20.726380 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:20.727305 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Oct 15 08:38:20.727701 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 18/36] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:38:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:20.738749 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:38:21.115754 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1c849136-812f-4852-9040-6844ff076328 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:21.133449 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1c849136-812f-4852-9040-6844ff076328 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399726 Oct 15 08:38:21.134015 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 19/37] 10.222.0.30 () {60 vars in 1292 bytes} [Sat Oct 15 08:38:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:38:22.434688 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:22.435745 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-0478a4d5-2a70-4b61-baab-94708d3a7292 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 15 08:38:22.436135 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 19/38] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:22.955698 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-433ce5a5-c0e3-45b1-ba5a-6d0a67797cc5 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:22.960892 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.wsgi [None req-433ce5a5-c0e3-45b1-ba5a-6d0a67797cc5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-433ce5a5-c0e3-45b1-ba5a-6d0a67797cc5 admin admin] Request method failure captured: Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept: application/json Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept-Encoding: gzip, deflate Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Connection: keep-alive Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Content-Length: 0 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Host: 10.222.0.30 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-System-Scope: None Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: User-Agent: python-novaclient Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Auth-Token: gAAAAABjSnF-0MQV9tS3ek1bvo1d6WlRwxSSS94wxAXybl2bQcf-IVxWnLIE154FWXKrftAvZgT5iWwVtsoVoD_5YBpsgke-eWM4uLLJV3sKr4dve3MgDjxtcL6u9lsl2iBwG5_JcZBMBL_Q7ryV4HPl2J8UhCz1awfP_I1KL5yVMNhYPGOMGEA Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Id: None Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Name: None Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Identity-Status: Confirmed Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Is-Admin-Project: True Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Id: default Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Name: Default Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Name: admin Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Role: member,admin,reader Oct 15 08:38:22.964198 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Roles: member,admin,reader Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant: admin Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Name: admin Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User: admin Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Id: default Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Name: Default Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Name: admin Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: method: > Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: exception: Flavor 42 could not be found. Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: action_args: {'id': '42'} Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:22.965792 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:22.966760 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:22.967919 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-433ce5a5-c0e3-45b1-ba5a-6d0a67797cc5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:22.969181 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-433ce5a5-c0e3-45b1-ba5a-6d0a67797cc5 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.392433 Oct 15 08:38:22.969181 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 20/39] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Oct 15 08:38:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 15 08:38:22.976247 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-d7336fe8-193b-46f4-b278-5ca3cdf807cc admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:23.000170 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-d7336fe8-193b-46f4-b278-5ca3cdf807cc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027845 Oct 15 08:38:23.000705 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 20/40] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:38:23.011193 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-9242fa92-b857-43c4-bfcb-cd68563dd783 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:23.032794 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-9242fa92-b857-43c4-bfcb-cd68563dd783 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025984 Oct 15 08:38:23.033317 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 21/41] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:38:23.043083 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-8e123636-a77d-40bf-b572-9bb9cdf45178 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:23.048241 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.wsgi [None req-8e123636-a77d-40bf-b572-9bb9cdf45178 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-8e123636-a77d-40bf-b572-9bb9cdf45178 admin admin] Request method failure captured: Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept: application/json Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept-Encoding: gzip, deflate Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Connection: keep-alive Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Content-Length: 0 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Host: 10.222.0.30 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-System-Scope: None Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: User-Agent: python-novaclient Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Auth-Token: gAAAAABjSnF-0MQV9tS3ek1bvo1d6WlRwxSSS94wxAXybl2bQcf-IVxWnLIE154FWXKrftAvZgT5iWwVtsoVoD_5YBpsgke-eWM4uLLJV3sKr4dve3MgDjxtcL6u9lsl2iBwG5_JcZBMBL_Q7ryV4HPl2J8UhCz1awfP_I1KL5yVMNhYPGOMGEA Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Id: None Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Name: None Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Identity-Status: Confirmed Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Is-Admin-Project: True Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Id: default Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Name: Default Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Name: admin Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Role: member,admin,reader Oct 15 08:38:23.052092 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Roles: member,admin,reader Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant: admin Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Name: admin Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User: admin Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Id: default Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Name: Default Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Name: admin Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: method: > Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: exception: Flavor 42 could not be found. Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: action_args: {'id': '42'} Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:23.053539 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:23.054376 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:23.055391 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-8e123636-a77d-40bf-b572-9bb9cdf45178 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:23.056388 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-8e123636-a77d-40bf-b572-9bb9cdf45178 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014106 Oct 15 08:38:23.056388 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 21/42] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Oct 15 08:38:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 08:38:24.262026 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-9242fa92-b857-43c4-bfcb-cd68563dd783 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:24.263041 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-9242fa92-b857-43c4-bfcb-cd68563dd783 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 15 08:38:24.263440 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 22/43] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:24.785337 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-93add9a2-01ca-4360-bc36-313acfb3f32d admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:24.790275 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.wsgi [None req-93add9a2-01ca-4360-bc36-313acfb3f32d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-93add9a2-01ca-4360-bc36-313acfb3f32d admin admin] Request method failure captured: Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept: application/json Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept-Encoding: gzip, deflate Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Connection: keep-alive Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Content-Length: 0 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Host: 10.222.0.30 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-System-Scope: None Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: User-Agent: python-novaclient Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Auth-Token: gAAAAABjSnGApfxlWHYLcYIrca1BXQ3LMz2VWbylWJOv4BBvWMopcQ7kQXATYe_f4Eb5oHKcue0QQwt2gUbAkYI-CM6u5ogf9QvZVmjD8NritZhhkd-V4MRuD1O-yfnX7WyWBqGEdAoU_Y8drLNHJS9jdWyvLcvYVmbIN1NvDBL1jfdcpJlmx78 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Id: None Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Name: None Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Identity-Status: Confirmed Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Is-Admin-Project: True Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Id: default Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Name: Default Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Name: admin Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Role: member,admin,reader Oct 15 08:38:24.791750 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Roles: member,admin,reader Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant: admin Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Name: admin Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User: admin Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Id: default Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Name: Default Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Name: admin Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: method: > Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: exception: Flavor 84 could not be found. Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: action_args: {'id': '84'} Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:24.792995 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:24.793822 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.795151 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-93add9a2-01ca-4360-bc36-313acfb3f32d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:24.796378 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-93add9a2-01ca-4360-bc36-313acfb3f32d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389991 Oct 15 08:38:24.796378 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 22/44] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Oct 15 08:38:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 08:38:24.803567 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-7753dae4-4887-4af7-a5ac-7d4dd5cab3b6 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:24.818730 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-7753dae4-4887-4af7-a5ac-7d4dd5cab3b6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019382 Oct 15 08:38:24.819254 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 23/45] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:38:24.828638 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-e28a3224-2047-49df-a7a6-4c3ed17c3f0e admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:24.843459 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-e28a3224-2047-49df-a7a6-4c3ed17c3f0e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018367 Oct 15 08:38:24.843966 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 23/46] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:38:24.853009 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-931918b3-fd2e-4350-8f44-599e0715c563 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:24.857927 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.wsgi [None req-931918b3-fd2e-4350-8f44-599e0715c563 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-931918b3-fd2e-4350-8f44-599e0715c563 admin admin] Request method failure captured: Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept: application/json Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept-Encoding: gzip, deflate Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Connection: keep-alive Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Content-Length: 0 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Host: 10.222.0.30 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-System-Scope: None Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: User-Agent: python-novaclient Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Auth-Token: gAAAAABjSnGApfxlWHYLcYIrca1BXQ3LMz2VWbylWJOv4BBvWMopcQ7kQXATYe_f4Eb5oHKcue0QQwt2gUbAkYI-CM6u5ogf9QvZVmjD8NritZhhkd-V4MRuD1O-yfnX7WyWBqGEdAoU_Y8drLNHJS9jdWyvLcvYVmbIN1NvDBL1jfdcpJlmx78 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Id: None Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Name: None Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Identity-Status: Confirmed Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Is-Admin-Project: True Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Id: default Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Name: Default Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Name: admin Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Role: member,admin,reader Oct 15 08:38:24.859428 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Roles: member,admin,reader Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant: admin Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Name: admin Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User: admin Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Id: default Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Name: Default Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Name: admin Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: method: > Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: exception: Flavor 84 could not be found. Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: action_args: {'id': '84'} Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:24.860887 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:24.862382 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:24.863423 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-931918b3-fd2e-4350-8f44-599e0715c563 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:24.864394 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-931918b3-fd2e-4350-8f44-599e0715c563 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011263 Oct 15 08:38:24.864394 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 24/47] 10.222.0.30 () {60 vars in 1190 bytes} [Sat Oct 15 08:38:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 08:38:26.067821 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-e28a3224-2047-49df-a7a6-4c3ed17c3f0e admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:26.068821 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-e28a3224-2047-49df-a7a6-4c3ed17c3f0e admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Oct 15 08:38:26.069207 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 24/48] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:26.590289 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-3c4544a0-0c4d-4f20-b55b-366698bba6a3 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:26.595969 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.wsgi [None req-3c4544a0-0c4d-4f20-b55b-366698bba6a3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-3c4544a0-0c4d-4f20-b55b-366698bba6a3 admin admin] Request method failure captured: Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept: application/json Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Accept-Encoding: gzip, deflate Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Connection: keep-alive Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Content-Length: 0 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Host: 10.222.0.30 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Openstack-System-Scope: None Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: User-Agent: python-novaclient Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Auth-Token: gAAAAABjSnGBF4zl7VpzMTbc99as5fisjSJ8ZqTQrzTL0ZRRYspRahz7R9iTWRCyvr8p-i0ni2Z0oaqBPfiUxecgIVOGJ4jybkdSbYNn6moL9nztdhIDf9ATNmeichEPZyihK2G45eBVkWviqDjBdIhEuJ8-0_U4hxorvLj0za5vbL75XnG8NQw Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Id: None Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Domain-Name: None Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Identity-Status: Confirmed Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Is-Admin-Project: True Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Id: default Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Domain-Name: Default Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Project-Name: admin Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Role: member,admin,reader Oct 15 08:38:26.598104 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Roles: member,admin,reader Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant: admin Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-Tenant-Name: admin Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User: admin Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Id: default Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Domain-Name: Default Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: X-User-Name: admin Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: method: > Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: exception: Flavor 451 could not be found. Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: action_args: {'id': '451'} Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:26.599559 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:26.600354 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.601891 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-3c4544a0-0c4d-4f20-b55b-366698bba6a3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110339) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:26.603138 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-3c4544a0-0c4d-4f20-b55b-366698bba6a3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395503 Oct 15 08:38:26.603138 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 25/49] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:38:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 08:38:26.609369 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-857f324c-7320-489e-a705-fcfb027808c1 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:26.624862 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-857f324c-7320-489e-a705-fcfb027808c1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019059 Oct 15 08:38:26.625405 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 25/50] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:38:26.634963 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:26.649704 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018021 Oct 15 08:38:26.650230 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 26/51] 10.222.0.30 () {60 vars in 1210 bytes} [Sat Oct 15 08:38:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:38:26.659582 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-26d4caf5-1d68-48c8-88f3-71c7a4fcad7f admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:26.664398 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.wsgi [None req-26d4caf5-1d68-48c8-88f3-71c7a4fcad7f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-26d4caf5-1d68-48c8-88f3-71c7a4fcad7f admin admin] Request method failure captured: Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept: application/json Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Accept-Encoding: gzip, deflate Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Connection: keep-alive Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Content-Length: 0 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Host: 10.222.0.30 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-Api-Version: compute 2.92 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Openstack-System-Scope: None Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: User-Agent: python-novaclient Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Auth-Token: gAAAAABjSnGBF4zl7VpzMTbc99as5fisjSJ8ZqTQrzTL0ZRRYspRahz7R9iTWRCyvr8p-i0ni2Z0oaqBPfiUxecgIVOGJ4jybkdSbYNn6moL9nztdhIDf9ATNmeichEPZyihK2G45eBVkWviqDjBdIhEuJ8-0_U4hxorvLj0za5vbL75XnG8NQw Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Id: None Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Domain-Name: None Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Identity-Status: Confirmed Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Is-Admin-Project: True Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Openstack-Nova-Api-Version: 2.92 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Id: default Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Domain-Name: Default Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Project-Name: admin Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Role: member,admin,reader Oct 15 08:38:26.665921 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Roles: member,admin,reader Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d200ced7ea7746bab37279a9888da771"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d200ced7ea7746bab37279a9888da771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d200ced7ea7746bab37279a9888da771", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant: admin Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Id: d200ced7ea7746bab37279a9888da771 Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-Tenant-Name: admin Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User: admin Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Id: default Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Domain-Name: Default Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Id: 6a470f28aa544b3cb42de175f4e32d94 Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: X-User-Name: admin Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: method: > Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: exception: Flavor 451 could not be found. Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: action_args: {'id': '451'} Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:38:26.667548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:26.668440 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: ERROR nova.api.openstack.wsgi Oct 15 08:38:26.669937 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-26d4caf5-1d68-48c8-88f3-71c7a4fcad7f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:38:26.671247 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-26d4caf5-1d68-48c8-88f3-71c7a4fcad7f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011706 Oct 15 08:38:26.671247 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 26/52] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:38:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 15 08:38:27.875170 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:27.876199 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 15 08:38:27.876587 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 27/53] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:38:28.391936 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-c23ea54c-65a4-4e3b-98ef-559e0b12260d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:28.412784 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-c23ea54c-65a4-4e3b-98ef-559e0b12260d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402123 Oct 15 08:38:28.413250 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 27/54] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Oct 15 08:38:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:38:29.624183 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:29.625247 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 15 08:38:29.625646 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 28/55] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:30.148111 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-ff041cab-c323-4a06-9f13-5ed589f310cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:30.167012 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-ff041cab-c323-4a06-9f13-5ed589f310cb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.408215 Oct 15 08:38:30.167548 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 28/56] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Oct 15 08:38:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 08:38:31.377157 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:31.378222 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 15 08:38:31.378613 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 29/57] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:31.891139 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-149449e4-1b4e-4285-83b6-b3046520c573 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:31.910467 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-149449e4-1b4e-4285-83b6-b3046520c573 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.397066 Oct 15 08:38:31.911000 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 29/58] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Oct 15 08:38:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:38:33.118151 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:33.119187 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 15 08:38:33.119583 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 30/59] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:33.635844 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-4707d03d-8be3-4ee0-9ce7-c8792d736faf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:38:33.654498 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-4707d03d-8be3-4ee0-9ce7-c8792d736faf admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.398201 Oct 15 08:38:33.655024 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 30/60] 10.222.0.30 () {64 vars in 1235 bytes} [Sat Oct 15 08:38:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 08:38:34.859222 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:34.860209 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Oct 15 08:38:34.860604 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 31/61] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:38:35.379407 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-f4821c75-17d0-4065-89d0-c8682b92f175 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:38:35.400136 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-f4821c75-17d0-4065-89d0-c8682b92f175 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401035 Oct 15 08:38:35.400297 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 31/62] 10.222.0.30 () {60 vars in 1202 bytes} [Sat Oct 15 08:38:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:39:31.613771 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:31.614318 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-31ae2c77-99ea-484e-b872-29d364a5dccb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 15 08:39:31.614719 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 32/63] 10.222.0.30 () {54 vars in 931 bytes} [Sat Oct 15 08:39:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:39:31.625091 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:39:32.000571 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-ec3b372f-c92d-474d-b6c8-5d6001089aa3 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:32.020545 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-ec3b372f-c92d-474d-b6c8-5d6001089aa3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399922 Oct 15 08:39:32.021085 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 32/64] 10.222.0.30 () {60 vars in 1292 bytes} [Sat Oct 15 08:39:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:39:32.042596 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_api:SELECT=14 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:39:32.047123 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-8aaae3f1-fd30-4675-9ea2-febaf4ed40e2 admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:32.054398 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-8aaae3f1-fd30-4675-9ea2-febaf4ed40e2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013205 Oct 15 08:39:32.054905 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 33/65] 10.222.0.30 () {60 vars in 1283 bytes} [Sat Oct 15 08:39:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:39:32.066127 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-59c1f623-d94f-4a66-8a29-0ed1db7794d9 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:32.073223 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-59c1f623-d94f-4a66-8a29-0ed1db7794d9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010583 Oct 15 08:39:32.073749 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 33/66] 10.222.0.30 () {60 vars in 1286 bytes} [Sat Oct 15 08:39:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:39:32.085718 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:32.092794 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011167 Oct 15 08:39:32.093885 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 34/67] 10.222.0.30 () {60 vars in 1286 bytes} [Sat Oct 15 08:39:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:39:32.104900 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-d4ff2787-301e-4942-a5b7-fd4f4ea89ef8 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:39:32.112577 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-d4ff2787-301e-4942-a5b7-fd4f4ea89ef8 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011093 Oct 15 08:39:32.113079 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1283 bytes} [Sat Oct 15 08:39:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:42:31.980257 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:31.981262 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 15 08:42:31.981656 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 35/69] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:42:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:42:32.124066 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_api:SELECT=6 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:42:32.281014 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:32.285780 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:32.286253 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:32.286677 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:32.287383 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:32.287842 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:32.288243 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:32.319505 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-7a5a32e1-9a0d-4c12-824b-19f65482b8b5 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.196563 Oct 15 08:42:32.320057 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 35/70] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:42:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:42:33.403910 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:33.404909 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 15 08:42:33.405309 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 36/71] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:42:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:42:33.595259 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:33.598727 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:33.599199 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:33.599623 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:33.600329 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:33.600768 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:33.601181 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:33.621270 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-6b7b5973-4bae-40f8-90a7-4346bc3352de admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076831 Oct 15 08:42:33.621830 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 36/72] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:42:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 15 08:42:45.094688 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:45.095687 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 15 08:42:45.096081 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 37/73] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:42:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:42:45.239021 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_cell0:SELECT=4 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:42:45.239733 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_cell1:SELECT=4 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:42:45.240339 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG dbcounter [-] [110340] Writing DB stats nova_api:SELECT=8 {{(pid=110340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:42:45.287567 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:45.291439 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:45.291910 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:45.292325 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:45.293022 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:45.293457 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:45.293908 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:45.319158 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-11f31ee3-9064-42d1-8e8a-91fe13208fd8 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084409 Oct 15 08:42:45.319632 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 37/74] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:42:45 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:42:46.392715 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG nova.api.openstack.wsgi [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] Calling method '>' {{(pid=110339) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:46.393748 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: INFO nova.api.openstack.requestlog [None req-1417e084-69e8-4095-b95f-8632bb63f7da admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 15 08:42:46.394147 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: [pid: 110339|app: 0|req: 38/75] 10.222.0.30 () {56 vars in 1074 bytes} [Sat Oct 15 08:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:42:46.583998 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG nova.api.openstack.wsgi [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Calling method '>' {{(pid=110340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:42:46.587512 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:46.587989 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:46.588417 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:46.589129 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:42:46.589573 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:42:46.590033 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: DEBUG oslo_concurrency.lockutils [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:42:46.611365 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: INFO nova.api.openstack.requestlog [None req-3400bdaa-0169-43a2-a1ed-5fdb96c1bf42 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.077951 Oct 15 08:42:46.612155 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: [pid: 110340|app: 0|req: 38/76] 10.222.0.30 () {60 vars in 1193 bytes} [Sat Oct 15 08:42:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:43:41.315646 dv-cinder-856971-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 15 08:43:41.316243 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: Sat Oct 15 08:43:41 2022 - graceful shutdown triggered... Oct 15 08:43:41.316707 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: Gracefully killing worker 1 (pid: 110339)... Oct 15 08:43:41.317084 dv-cinder-856971-3-iscsi devstack@n-api.service[110340]: Gracefully killing worker 2 (pid: 110340)... Oct 15 08:43:41.442206 dv-cinder-856971-3-iscsi devstack@n-api.service[110339]: DEBUG dbcounter [-] [110339] Writing DB stats nova_api:SELECT=4 {{(pid=110339) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:43:42.317396 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: worker 1 buried after 1 seconds Oct 15 08:43:42.317960 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: worker 2 buried after 1 seconds Oct 15 08:43:42.317960 dv-cinder-856971-3-iscsi devstack@n-api.service[110338]: goodbye to uWSGI. Oct 15 08:43:42.318971 dv-cinder-856971-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 15 08:43:42.319536 dv-cinder-856971-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 15 08:43:42.322330 dv-cinder-856971-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 15 08:43:42.332872 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 15 08:43:42 2022] *** Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: nodename: dv-cinder-856971-3-iscsi Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: machine: x86_64 Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: clock source: unix Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: pcre jit disabled Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: detected number of CPU cores: 4 Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: current working directory: / Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: detected binary path: /usr/bin/uwsgi-core Oct 15 08:43:42.334759 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: your processes number limit is 47680 Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: your memory page size is 4096 bytes Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: detected max file descriptor number: 2048 Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: lock engine: pthread robust mutexes Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: thunder lock: enabled Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 15 08:43:42.335621 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 15 08:43:42.378568 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: Python main interpreter initialized at 0x5570d636f9c0 Oct 15 08:43:42.378568 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: python threads support enabled Oct 15 08:43:42.378568 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: your server socket listen backlog is limited to 100 connections Oct 15 08:43:42.378568 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: your mercy for graceful operations on workers is 90 seconds Oct 15 08:43:42.379036 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: mapped 403077 bytes (393 KB) for 2 cores Oct 15 08:43:42.379036 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: *** Operational MODE: preforking *** Oct 15 08:43:42.379274 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: *** uWSGI is running in multiple interpreter mode *** Oct 15 08:43:42.379274 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: spawned uWSGI master process (pid: 125312) Oct 15 08:43:42.379486 dv-cinder-856971-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 15 08:43:42.380056 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: spawned uWSGI worker 1 (pid: 125327, cores: 1) Oct 15 08:43:42.380577 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: spawned uWSGI worker 2 (pid: 125329, cores: 1) Oct 15 08:43:42.380861 dv-cinder-856971-3-iscsi devstack@n-api.service[125312]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 15 08:43:43.043123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 08:43:43.044729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 15 08:43:44.205259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:43:44.205259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: from cryptography.utils import int_from_bytes Oct 15 08:43:44.206058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:43:44.206058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: from cryptography.utils import int_from_bytes Oct 15 08:43:44.206808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:43:44.206808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: from cryptography.utils import int_from_bytes Oct 15 08:43:44.207274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 15 08:43:44.207274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: from cryptography.utils import int_from_bytes Oct 15 08:43:46.635721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 08:43:46.636388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 08:43:46.636510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 08:43:46.636875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 08:43:46.636994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 15 08:43:46.637358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 08:43:46.637448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 15 08:43:46.637542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.637713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 15 08:43:46.637830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.638086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 15 08:43:46.638195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.638339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 15 08:43:46.638467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.638729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.638830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.639787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.640944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-3-iscsi {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.641869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856971-3-iscsi {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.642952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.643897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.644205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.644510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.644627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.644827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.645942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.646873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.647892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-3-iscsi {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.648374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.648523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.648702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.648798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856971-3-iscsi {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.649898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.650857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.651856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.652978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.653955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.654943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.655832 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.656933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.657922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.658840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.659965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.660912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.661945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.662888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.663865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.664835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.665955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.666075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.666814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.666958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.667841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.668955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.669899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.670910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.671834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.672955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.673987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.674906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.675825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.676959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.677988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.678896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.679803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.680930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.681030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.681238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.681337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.681544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.681645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.682406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.682516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.682716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.682807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.683042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 15 08:43:46.683173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.683376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.683474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.683706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.683803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.684785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685755 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.685981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.686915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.687965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.688945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.689878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.690830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.691809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.692977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.693959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.694909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.695940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.696874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.697903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.698860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.699981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.700901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.701968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.702914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.703833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.704965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.705921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.706935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.707867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.708803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.709766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.710943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.711961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.712872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.713612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.713737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.713958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.714967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.715888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.716810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.717818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.718996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.719926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.720963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.721919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.722872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.723851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.724795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.725964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.726991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.727924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.728152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.728242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.728459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.728559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.729329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.729427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.729663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.729788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.730956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.731958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.732872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.733849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.734963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.735974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.736963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.737871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.738989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.739926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.740948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.741962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.742848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.743996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.744956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.745908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.746890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.747135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.747398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.747492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.747729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.747821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.748810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.749994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.750996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.751925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.752819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.753965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.754999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.755906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.756857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.757843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.758804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.759946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.760964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.761908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.762822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.763938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.764944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.765881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.766797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.767916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.768941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769305 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.769858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.770983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.771991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.772897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.773108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.773453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.773666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.773783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.773990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.774994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.775205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.775308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.776956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.777993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.778932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.779953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.780896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.781823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.782777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.783932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.784952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.785912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.786844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.787982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788748 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.788997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.789958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.790162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.790266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.790469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.790585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.790899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.791008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.791789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.791904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.792818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.793787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.794819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.795954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.796983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.797952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.798957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.799991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.800937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.801901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.802860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.803847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.804980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.805085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.805305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.805406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.805742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.805836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.806847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.807991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.808926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.809988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.810898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.811854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.812809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.813968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.814925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.815969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.816959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.817926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.818838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.819960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.820970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.821934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.822901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.823808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.824994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.825973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.826923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.827951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.828166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.828266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.828478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.828693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.828786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.829971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.830911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.831922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.832880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.833876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.834818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.835975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.836909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.837965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.838691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.838795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.839941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.840904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.841927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.842154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.842383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.842484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.842699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.842814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.843999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.844953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.845905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.846938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.847140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.847258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.847455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.847674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.847766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.848948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.849933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.850963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.851928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.852798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.853001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.853094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.853305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.853397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.853634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.854335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.854509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.854613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.854821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.854914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.855850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.856976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.857924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.858911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.859957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.860886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.861861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.862945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.863039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.863291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.863569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.863671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.863907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.864983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.865930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.866882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.867826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.868961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.869972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.870915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.871890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.872964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.873915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.874828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875141 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.875867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.876805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.877813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.878991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.879922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.880931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.881873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.882992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.883992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.884912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.885848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.886968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.887899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.888965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.889921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.890866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.891809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.892948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.893930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.894971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.895915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.896850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.897803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.898990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.899202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.899303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.899517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.899618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.899876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.900011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.900156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.900283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.900463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.901071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.901310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.901411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.901635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.901764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.902961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.903055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.903270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.903371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.903514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125327) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 08:43:46.903615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.903870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 15 08:43:46.904114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 15 08:43:46.965334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO dbcounter [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Registered counter for database nova_api Oct 15 08:43:46.965742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO dbcounter [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Registered counter for database nova_api Oct 15 08:43:46.985519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_db.sqlalchemy.engines [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:46.986995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_db.sqlalchemy.engines [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:46.992478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writer thread running {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:46.993672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writer thread running {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.049324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.context [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0b25d10-5217-4459-9654-b7e7b9f4e0c0(cell1) {{(pid=125327) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 08:43:47.050493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.context [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a0b25d10-5217-4459-9654-b7e7b9f4e0c0(cell1) {{(pid=125329) load_cells /opt/stack/nova/nova/context.py:464}} Oct 15 08:43:47.053352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:43:47.053872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:43:47.054469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:43:47.054953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:43:47.055457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:43:47.056186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:43:47.056530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:43:47.056672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:43:47.057830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:43:47.058294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:43:47.059186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:43:47.060278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:43:47.061171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO dbcounter [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Registered counter for database nova_cell0 Oct 15 08:43:47.062272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO dbcounter [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Registered counter for database nova_cell0 Oct 15 08:43:47.065200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO dbcounter [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Registered counter for database nova_cell1 Oct 15 08:43:47.066393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO dbcounter [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Registered counter for database nova_cell1 Oct 15 08:43:47.073241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_db.sqlalchemy.engines [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.075970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_db.sqlalchemy.engines [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.077494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_db.sqlalchemy.engines [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.079410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_db.sqlalchemy.engines [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.084706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writer thread running {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.088010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writer thread running {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.088363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writer thread running {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.225037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writer thread running {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.235723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO dbcounter [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Registered counter for database nova_cell0 Oct 15 08:43:47.235910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO dbcounter [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Registered counter for database nova_cell0 Oct 15 08:43:47.242502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_db.sqlalchemy.engines [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.245889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_db.sqlalchemy.engines [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125327) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 15 08:43:47.249199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writer thread running {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.250465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writer thread running {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 15 08:43:47.571412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: WARNING keystonemiddleware.auth_token [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:43:47.574203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: WARNING keystonemiddleware.auth_token [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:43:47.578788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: WARNING keystonemiddleware.auth_token [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:43:47.581530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: WARNING keystonemiddleware.auth_token [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:43:47.923901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: WARNING keystonemiddleware.auth_token [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:43:47.928043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: WARNING keystonemiddleware.auth_token [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 15 08:43:47.929861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: WARNING keystonemiddleware.auth_token [None req-1c331411-cc2b-492c-bed3-dc6135287ea3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:43:47.934617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: WARNING keystonemiddleware.auth_token [None req-47c55463-3a1a-43fd-8de3-0bd450369736 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 15 08:43:47.935716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570d636f9c0 pid: 125327 (default app) Oct 15 08:43:47.939882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5570d636f9c0 pid: 125329 (default app) Oct 15 08:44:23.566355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:23.568561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:23.569809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:23.570781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:25.475120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d3c68fc9-2d9e-43ba-8f6b-4d4615a07e1d tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Action: 'create', calling method: .version_select at 0x7f575bd2a550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2028986929"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:26.658012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d3c68fc9-2d9e-43ba-8f6b-4d4615a07e1d tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.108628 Oct 15 08:44:26.658715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1/1] 10.222.0.30 () {60 vars in 1155 bytes} [Sat Oct 15 08:44:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3113 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 15 08:44:26.676847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:26.682773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:26.684503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:26.688637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:26.951169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5e460a32-4094-4614-adef-070a1f1917c7 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bd770d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:27.378554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6ca04978-2992-4c09-9305-79eacfba7b4f tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bbf9430>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:27.498519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6ca04978-2992-4c09-9305-79eacfba7b4f tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0e32b76c-b68c-42db-a2fb-9ca2092c2eab" status: 200 len: 350 microversion: 2.1 time: 0.127689 Oct 15 08:44:27.499156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 2/2] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:27 2022] GET /compute/v2.1/os-volumes/0e32b76c-b68c-42db-a2fb-9ca2092c2eab => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:44:27.627658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5e460a32-4094-4614-adef-070a1f1917c7 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878" status: 200 len: 346 microversion: 2.1 time: 0.955770 Oct 15 08:44:27.628721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1/3] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:26 2022] GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 => generated 346 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:27.643077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4a40886-9f95-47d4-b0d3-b2010441b635 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Action: 'create', calling method: .version_select at 0x7f575bbf9af0>, body: {"snapshot": {"volume_id": "3297af9c-a8a7-4202-918e-eeb34d27e878", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-564627295"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:28.086469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4a40886-9f95-47d4-b0d3-b2010441b635 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.446736 Oct 15 08:44:28.087390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 3/4] 10.222.0.30 () {60 vars in 1162 bytes} [Sat Oct 15 08:44:27 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:28.098424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d87a8406-ccc7-4b53-b393-e78f7911e540 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bc3c3a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:28.472412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d87a8406-ccc7-4b53-b393-e78f7911e540 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 286 microversion: 2.1 time: 0.378144 Oct 15 08:44:28.473032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 2/5] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:28 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 286 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:28.485037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c4dba87f-11c3-4e85-9fd0-2b3f0a5d5244 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bb94ca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:28.558855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c4dba87f-11c3-4e85-9fd0-2b3f0a5d5244 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.078133 Oct 15 08:44:28.559417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 4/6] 10.222.0.30 () {58 vars in 1140 bytes} [Sat Oct 15 08:44:28 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:28.573309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-60776d05-f620-43bf-a2ac-71de24fe416c tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bc3caf0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:28.634639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-60776d05-f620-43bf-a2ac-71de24fe416c tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 286 microversion: 2.1 time: 0.067630 Oct 15 08:44:28.635486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 3/7] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:28 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:29.225235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3c4723ea-1f90-4609-8fa7-32356afa4eaa tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bd2a670>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:29.320960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3c4723ea-1f90-4609-8fa7-32356afa4eaa tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/472ac33d-6dfa-43ab-a633-ec7eab9b2f78" status: 200 len: 350 microversion: 2.1 time: 0.100098 Oct 15 08:44:29.323595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 5/8] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:29 2022] GET /compute/v2.1/os-volumes/472ac33d-6dfa-43ab-a633-ec7eab9b2f78 => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:29.654360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f051817e-94ae-4adb-86c9-a8ce68036492 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bbf31f0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:29.723871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f051817e-94ae-4adb-86c9-a8ce68036492 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 286 microversion: 2.1 time: 0.077710 Oct 15 08:44:29.724568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 4/9] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:29 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:30.737260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-115b623b-2d21-4b08-9c4a-5a2d6271004a tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bbf9a60>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:30.801026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-115b623b-2d21-4b08-9c4a-5a2d6271004a tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 286 microversion: 2.1 time: 0.068138 Oct 15 08:44:30.802391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 6/10] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:30 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:31.815409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6f7423e7-8f96-4bdc-910f-073ff3fc6dc7 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bc3cc10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:31.890757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6f7423e7-8f96-4bdc-910f-073ff3fc6dc7 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 287 microversion: 2.1 time: 0.079873 Oct 15 08:44:31.891874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 5/11] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:31 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:31.903814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4d017234-f014-48b1-8c3b-789b2ef21174 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bbf91f0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:32.080528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4d017234-f014-48b1-8c3b-789b2ef21174 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 202 len: 0 microversion: 2.1 time: 0.180978 Oct 15 08:44:32.085024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 7/12] 10.222.0.30 () {58 vars in 1254 bytes} [Sat Oct 15 08:44:31 2022] DELETE /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:44:32.092046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5da4cb3e-c769-4653-afe8-7ce581176b1f tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bc3c4c0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:32.180877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5da4cb3e-c769-4653-afe8-7ce581176b1f tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 200 len: 286 microversion: 2.1 time: 0.094022 Oct 15 08:44:32.183022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 6/13] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:32 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:32.672137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-00c265d2-38d2-4c47-a621-49272fce2236 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bbf9af0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:32.783523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-00c265d2-38d2-4c47-a621-49272fce2236 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/89f04a27-9528-47d1-9055-b003e15bcaa4" status: 200 len: 351 microversion: 2.1 time: 0.115257 Oct 15 08:44:32.784098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 8/14] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:32 2022] GET /compute/v2.1/os-volumes/89f04a27-9528-47d1-9055-b003e15bcaa4 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:32.797903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ac03cc18-04e5-4876-94db-47eb40e5ed48 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bbf3310>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:33.104532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ac03cc18-04e5-4876-94db-47eb40e5ed48 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.304611 Oct 15 08:44:33.106008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 7/15] 10.222.0.30 () {58 vars in 1134 bytes} [Sat Oct 15 08:44:32 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:33.126133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6f266d68-284f-4417-b356-262b95986413 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bc3c5e0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:33.365982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6f266d68-284f-4417-b356-262b95986413 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.249437 Oct 15 08:44:33.367045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 8/16] 10.222.0.30 () {58 vars in 1149 bytes} [Sat Oct 15 08:44:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:33.374565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-61138eeb-32fc-4574-8f11-5e8411e9632e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bc05700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:33.425013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-61138eeb-32fc-4574-8f11-5e8411e9632e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] HTTP exception thrown: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-61138eeb-32fc-4574-8f11-5e8411e9632e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Request method failure captured: Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e HTTP/1.1 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnLnczU5qXzGVzyUIESoCujJCOjt1UQP4U5GNZFFY3PJlsAGMg3ury8DR1kq0Mrvc9moirEInK8RyBmGnA8Qr2heHqe6Fn8FpvJzHEpKs8tCiAdFoU05s2HjmEYTVdWzI0uwjQihJ59xKBwi8rJFAvwd9ldboU6nJtn0aNJPPq_nZa0 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:44:33.430045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d913701e44d244b9b5c2cda61d85cd32", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: cdfa309c37d943b992f6ca1c647557af Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '53a53eda-9274-491d-982d-ebbdb50f212e'} Oct 15 08:44:33.432077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. (HTTP 404) (Request-ID: req-4b561ebd-f7d3-482c-8acb-6b68a8a20c55) Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.432878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:33.436195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 15 08:44:33.439217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-61138eeb-32fc-4574-8f11-5e8411e9632e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Returning 404 to user: Snapshot 53a53eda-9274-491d-982d-ebbdb50f212e could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-61138eeb-32fc-4574-8f11-5e8411e9632e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e" status: 404 len: 111 microversion: 2.1 time: 0.063966 Oct 15 08:44:33.442300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 9/17] 10.222.0.30 () {58 vars in 1251 bytes} [Sat Oct 15 08:44:33 2022] GET /compute/v2.1/os-snapshots/53a53eda-9274-491d-982d-ebbdb50f212e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:44:33.452876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a0e41282-88cc-4293-a7f9-0361366938ec tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bbf3700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:33.679323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f696cde-5c20-4e53-8792-a236788d9c80 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: .version_select at 0x7f575bbf9820>, body: {"keypair": {"name": "tempest-keypair-502744667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5/dDyObexiGXHL2dojBtcd40iHNjXKQpzsCrouMUgQZTY/vV9SHhpvNT+GegrxbJJnyKB8tJwjKRZAAGkzdl8TbNpaEKlzwfA5DuxZGIt2URgR7Lz19C6QPy2M+X+XXA=="}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:33.720903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a0e41282-88cc-4293-a7f9-0361366938ec tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.279851 Oct 15 08:44:33.721525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1134 bytes} [Sat Oct 15 08:44:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:33.726700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5df172b3-45e3-483a-b038-ac8c4bfb7d05 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bbf3280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:33.838072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-2f696cde-5c20-4e53-8792-a236788d9c80 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for project becb9cd46453447a87846cf26561a190. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:33.870339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-2f696cde-5c20-4e53-8792-a236788d9c80 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for user a5d85f7efca040cc81253dfbf0de7c42 and project becb9cd46453447a87846cf26561a190. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:33.911609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5df172b3-45e3-483a-b038-ac8c4bfb7d05 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878" status: 202 len: 0 microversion: 2.1 time: 0.188874 Oct 15 08:44:33.916183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 11/19] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:44:33 2022] DELETE /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:44:33.921422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-66e15b3d-8f73-4eb6-90e6-798fbe64707c tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575c550c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.030656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f696cde-5c20-4e53-8792-a236788d9c80 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.079186 Oct 15 08:44:34.031648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 9/20] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 08:44:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:44:34.047111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58998c06-2cb8-4c7a-a416-0d5bdad46c3e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bb7b8b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.172076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-58998c06-2cb8-4c7a-a416-0d5bdad46c3e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] HTTP exception thrown: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58998c06-2cb8-4c7a-a416-0d5bdad46c3e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Request method failure captured: Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 HTTP/1.1 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLnczU5qXzGVzyUIESoCujJCOjt1UQP4U5GNZFFY3PJlsAGMg3ury8DR1kq0Mrvc9moirEInK8RyBmGnA8Qr2heHqe6Fn8FpvJzHEpKs8tCiAdFoU05s2HjmEYTVdWzI0uwjQihJ59xKBwi8rJFAvwd9ldboU6nJtn0aNJPPq_nZa0 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:34.178978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d913701e44d244b9b5c2cda61d85cd32", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: cdfa309c37d943b992f6ca1c647557af Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '3297af9c-a8a7-4202-918e-eeb34d27e878'} Oct 15 08:44:34.181036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. (HTTP 404) (Request-ID: req-53772b75-d528-49a4-908d-cbfd5a63e4c6) Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.182947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:34.184613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 08:44:34.186013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.187375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.189501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58998c06-2cb8-4c7a-a416-0d5bdad46c3e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Returning 404 to user: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:34.192512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-58998c06-2cb8-4c7a-a416-0d5bdad46c3e tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878" status: 404 len: 109 microversion: 2.1 time: 0.157964 Oct 15 08:44:34.197936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 10/21] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:34 2022] GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:44:34.228447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-34413ad9-dfa2-49f5-8000-7bb947d746b5 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bbf94c0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.263526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-66e15b3d-8f73-4eb6-90e6-798fbe64707c tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.345769 Oct 15 08:44:34.272980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 12/22] 10.222.0.30 () {58 vars in 1167 bytes} [Sat Oct 15 08:44:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:34.279707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9a22df8c-8314-4dd7-afcd-b5ffb0a86ef6 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bb6c0d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.322196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-34413ad9-dfa2-49f5-8000-7bb947d746b5 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] HTTP exception thrown: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-34413ad9-dfa2-49f5-8000-7bb947d746b5 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Request method failure captured: Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 HTTP/1.1 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLnczU5qXzGVzyUIESoCujJCOjt1UQP4U5GNZFFY3PJlsAGMg3ury8DR1kq0Mrvc9moirEInK8RyBmGnA8Qr2heHqe6Fn8FpvJzHEpKs8tCiAdFoU05s2HjmEYTVdWzI0uwjQihJ59xKBwi8rJFAvwd9ldboU6nJtn0aNJPPq_nZa0 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:34.324487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d913701e44d244b9b5c2cda61d85cd32", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: cdfa309c37d943b992f6ca1c647557af Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '3297af9c-a8a7-4202-918e-eeb34d27e878'} Oct 15 08:44:34.326069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. (HTTP 404) (Request-ID: req-c1adb8f6-7aee-416f-b929-7339510c36c2) Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.327039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:34.328527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 08:44:34.330241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-34413ad9-dfa2-49f5-8000-7bb947d746b5 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Returning 404 to user: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-34413ad9-dfa2-49f5-8000-7bb947d746b5 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878" status: 404 len: 109 microversion: 2.1 time: 0.120948 Oct 15 08:44:34.332438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 11/23] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:44:34 2022] DELETE /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:44:34.347837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e20b9685-60a9-4166-a27f-7748296f66c8 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Calling method '.version_select at 0x7f575bb0a3a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.432024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-e20b9685-60a9-4166-a27f-7748296f66c8 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] HTTP exception thrown: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e20b9685-60a9-4166-a27f-7748296f66c8 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Request method failure captured: Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 HTTP/1.1 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLnczU5qXzGVzyUIESoCujJCOjt1UQP4U5GNZFFY3PJlsAGMg3ury8DR1kq0Mrvc9moirEInK8RyBmGnA8Qr2heHqe6Fn8FpvJzHEpKs8tCiAdFoU05s2HjmEYTVdWzI0uwjQihJ59xKBwi8rJFAvwd9ldboU6nJtn0aNJPPq_nZa0 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:34.434416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d913701e44d244b9b5c2cda61d85cd32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d913701e44d244b9b5c2cda61d85cd32", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d913701e44d244b9b5c2cda61d85cd32 Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650456412 Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: cdfa309c37d943b992f6ca1c647557af Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650456412-project Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '3297af9c-a8a7-4202-918e-eeb34d27e878'} Oct 15 08:44:34.436094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. (HTTP 404) (Request-ID: req-ea23276f-becb-4706-8ece-0773a186fb54) Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.437073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:34.438496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 08:44:34.440136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e20b9685-60a9-4166-a27f-7748296f66c8 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] Returning 404 to user: Volume 3297af9c-a8a7-4202-918e-eeb34d27e878 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e20b9685-60a9-4166-a27f-7748296f66c8 tempest-VolumesSnapshotsTestJSON-650456412 tempest-VolumesSnapshotsTestJSON-650456412-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878" status: 404 len: 109 microversion: 2.1 time: 0.104551 Oct 15 08:44:34.441467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:34 2022] GET /compute/v2.1/os-volumes/3297af9c-a8a7-4202-918e-eeb34d27e878 => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 08:44:34.600163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9a22df8c-8314-4dd7-afcd-b5ffb0a86ef6 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.325484 Oct 15 08:44:34.609948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1170 bytes} [Sat Oct 15 08:44:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:34.617526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fc843994-4807-49ba-8f09-e1067221de51 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bb94e50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:34.859972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fc843994-4807-49ba-8f09-e1067221de51 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.248652 Oct 15 08:44:34.860816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 13/26] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Oct 15 08:44:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:34.875885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3c8dc746-1fb5-4053-8e78-01ebcbe7cbef tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575bb6caf0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:35.050418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3c8dc746-1fb5-4053-8e78-01ebcbe7cbef tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.178966 Oct 15 08:44:35.051564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1188 bytes} [Sat Oct 15 08:44:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:35.065512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b0878ef4-0195-427f-9ceb-fd429df69691 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] Calling method '.version_select at 0x7f575ba98040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:35.229103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b0878ef4-0195-427f-9ceb-fd429df69691 tempest-VolumesTestJSON-1405816451 tempest-VolumesTestJSON-1405816451-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.167442 Oct 15 08:44:35.230206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 14/28] 10.222.0.30 () {58 vars in 1155 bytes} [Sat Oct 15 08:44:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:41.308274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-457191475", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:41.515881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] validate_networks() for [('1046b26e-bd5e-400a-be3a-55057f3584b9', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:44:42.027250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1793090218", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "networks": [{"uuid": "20cc5c6f-750b-4332-be14-540451884065"}]}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:42.217255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] validate_networks() for [('20cc5c6f-750b-4332-be14-540451884065', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:44:43.646555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:44:43.647039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:44:43.647339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:44:43.647897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:44:43.648438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:44:43.675528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:43.678208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:43.678859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:43.682954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:43.683432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:43.683864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:43.759483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Getting quotas for project f67051bce2414ff791a2a1e1a638cadc. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:43.771698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Getting quotas for user 9cc9e2cf11804cc39a7de3c314e46679 and project f67051bce2414ff791a2a1e1a638cadc. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:43.796403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:44:43.803047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:44:43.915926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:43.952227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc9c284f-14c6-4016-940a-c9fa12b05cac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.903494 Oct 15 08:44:43.952950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 15/29] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:44:41 2022] POST /compute/v2.1/servers => generated 383 bytes in 2905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:44:43.997598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:44:43.998045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:44:43.998663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:44:43.999129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:44:43.999543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:44:44.030760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:44.032408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:44.037555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:44.040661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:44.041317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:44.042260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:44.112355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Getting quotas for project bccc9c2f8b8f4bc3a4dbc121a32d82ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:44.125309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Getting quotas for user 2b1999640b3c41beafefe80d40bf965c and project bccc9c2f8b8f4bc3a4dbc121a32d82ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:44.158712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:44:44.161589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:44:44.343471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bb9a8a2b-9e06-4f87-968a-8281856a57dc tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.588519 Oct 15 08:44:44.344168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 15/30] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:44:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 15 08:44:44.742392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7b44441d-4fd6-452d-a386-952e1d86d159 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'create', calling method: .version_select at 0x7f575b27d160>, body: {"keypair": {"name": "tempest-keypair-882221769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA5Tef0vzu5c79UwXVuNvoJMviDkxR6RjBFvjOKxkx2iLsaUb5mDgtfFPYCkjDHBhVd1KJW2HyTtrQtJStuc3EveN/PoVIEnJCxSngeqUSVtgODSQZLEfVcfJO6nSJQOQ=="}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:44.786781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-7b44441d-4fd6-452d-a386-952e1d86d159 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for project 23e3a95b1487450cad043a820d321f26. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:44.795706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-7b44441d-4fd6-452d-a386-952e1d86d159 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for user 388ca829d87348bd9b524fd9a80e578b and project 23e3a95b1487450cad043a820d321f26. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:44.868668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7b44441d-4fd6-452d-a386-952e1d86d159 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.902355 Oct 15 08:44:44.880540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 16/31] 10.222.0.30 () {62 vars in 1200 bytes} [Sat Oct 15 08:44:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 926 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 15 08:44:44.886365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2439c308-5ca0-4589-b73c-f362c1085f75 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:44.886989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2439c308-5ca0-4589-b73c-f362c1085f75 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:44.986680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ee1938f-c96b-4b5e-946c-6b77bddd6d58 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Action: 'create', calling method: .version_select at 0x7f575ba25700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-221788676", "metadata": {"Type": "work"}}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ee1938f-c96b-4b5e-946c-6b77bddd6d58 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 121 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:44.998557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-221788676", "metadata": {"Type": "work"}}} Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:45.000116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-221788676', 'metadata': {'Type': 'work'}}}} Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise error Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi '#$%' Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:45.000950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 08:44:45.002320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 08:44:45.003445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 15 08:44:45.003445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.005170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ee1938f-c96b-4b5e-946c-6b77bddd6d58 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:45.010473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1ee1938f-c96b-4b5e-946c-6b77bddd6d58 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.652185 Oct 15 08:44:45.013085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 16/32] 10.222.0.30 () {60 vars in 1156 bytes} [Sat Oct 15 08:44:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 668 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 08:44:45.047414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1965899824", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e61cdcd-c5f4-41ef-bbf5-ce16b32429c6"}], "security_groups": [{"name": "tempest-securitygroup--1260542462"}], "key_name": "tempest-keypair-502744667", "user_data": "}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:45.272525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2439c308-5ca0-4589-b73c-f362c1085f75 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:45.341667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2439c308-5ca0-4589-b73c-f362c1085f75 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1221 microversion: 2.1 time: 0.459896 Oct 15 08:44:45.342285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:44 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1221 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:45.372264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e72e6551-379b-4e74-9fd0-f83ef248ed99 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:45.373967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e72e6551-379b-4e74-9fd0-f83ef248ed99 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:45.502465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] validate_networks() for [('4e61cdcd-c5f4-41ef-bbf5-ce16b32429c6', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:44:45.598499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e72e6551-379b-4e74-9fd0-f83ef248ed99 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:45.616602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e72e6551-379b-4e74-9fd0-f83ef248ed99 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1215 microversion: 2.1 time: 0.265979 Oct 15 08:44:45.618814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 18/34] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:45 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:45.645837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9e79695e-d8b4-48fe-9ce0-b53567da55b8 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Action: 'create', calling method: .version_select at 0x7f575b247ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1935161993", "metadata": {"Type": "work"}}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9e79695e-d8b4-48fe-9ce0-b53567da55b8 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 120 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:44:45.667012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1935161993", "metadata": {"Type": "work"}}} Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: Oct 15 08:44:45.668376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1935161993', 'metadata': {'Type': 'work'}}}} Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise error Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi '0' Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:45.669159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 08:44:45.670855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 08:44:45.672286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 15 08:44:45.672286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:45.677468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9e79695e-d8b4-48fe-9ce0-b53567da55b8 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:45.679191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9e79695e-d8b4-48fe-9ce0-b53567da55b8 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.057317 Oct 15 08:44:45.684466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 19/35] 10.222.0.30 () {60 vars in 1156 bytes} [Sat Oct 15 08:44:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 08:44:46.464973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-99bde94a-ed7b-4376-872b-cf5307d9c07b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: .version_select at 0x7f575b1e2670>, body: {"keypair": {"name": "tempest-keypair-498952549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9b0ALxmX6jOVeLB8SAoHFP4w+JYMEbj6hvr92Da06FAYlnEdmciopwuRDIf6DyTxdOPnQuHQqXQQN27iYzMuHTlpKgF/jQRHq0EfMf4plYvVunfYL/LU8SwCOJrUVsew=="}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:46.566519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-99bde94a-ed7b-4376-872b-cf5307d9c07b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:46.584936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-99bde94a-ed7b-4376-872b-cf5307d9c07b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:46.724625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-99bde94a-ed7b-4376-872b-cf5307d9c07b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.036449 Oct 15 08:44:46.735765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 20/36] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 08:44:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:44:46.798931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-31266d01-e9b9-4f6d-a18e-aa55694e3de0 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Action: 'create', calling method: .version_select at 0x7f575b22a9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-363941640", "metadata": {"Type": "work"}}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-31266d01-e9b9-4f6d-a18e-aa55694e3de0 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 118 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:44:46.811738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-363941640", "metadata": {"Type": "work"}}} Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: Oct 15 08:44:46.812815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-363941640', 'metadata': {'Type': 'work'}}}} Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise error Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi '' Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:46.813433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 15 08:44:46.814769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 15 08:44:46.815628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 15 08:44:46.815628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:44:46.819612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-31266d01-e9b9-4f6d-a18e-aa55694e3de0 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:46.823011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-31266d01-e9b9-4f6d-a18e-aa55694e3de0 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.046218 Oct 15 08:44:46.823616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 21/37] 10.222.0.30 () {60 vars in 1156 bytes} [Sat Oct 15 08:44:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 87 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 08:44:46.842045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1277557423", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:46.934595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] validate_networks() for [('1046b26e-bd5e-400a-be3a-55057f3584b9', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:44:47.384070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:44:47.385242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:44:47.385721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:44:47.386131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:44:47.386543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:44:47.409996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:47.410692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:47.411279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:47.412237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:47.412848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:47.413420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:47.483057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for project becb9cd46453447a87846cf26561a190. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:47.494883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for user a5d85f7efca040cc81253dfbf0de7c42 and project becb9cd46453447a87846cf26561a190. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:47.522039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:44:47.533320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:44:47.654683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9af0425c-975e-4b32-835d-32358a144549 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.629209 Oct 15 08:44:47.662148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 17/38] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:44:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:44:47.668895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:47.669862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:47.689808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:47.690321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:47.690759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:47.691469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:47.691927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:47.692347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:48.204633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:48.243519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-49c432cf-cdd1-4296-b2b2-a76a4a8d535a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1219 microversion: 2.1 time: 0.578999 Oct 15 08:44:48.265470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 18/39] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:47 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1219 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:48.282325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18fd7417-3060-4d36-97c5-2cff2bd15838 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Calling method '.version_select at 0x7f575ba34dc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:48.408786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-18fd7417-3060-4d36-97c5-2cff2bd15838 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] HTTP exception thrown: Volume tempest-invalid-2126924150 could not be found. Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18fd7417-3060-4d36-97c5-2cff2bd15838 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2126924150 HTTP/1.1 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:48.410797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume tempest-invalid-2126924150 could not be found. Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': 'tempest-invalid-2126924150'} Oct 15 08:44:48.412123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2126924150 could not be found. (HTTP 404) (Request-ID: req-b770ca63-4136-4a24-b56d-89f38f2e1f88) Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.412920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:48.414123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2126924150 could not be found. Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:48.416979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2126924150 could not be found. Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2126924150 could not be found. Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18fd7417-3060-4d36-97c5-2cff2bd15838 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 404 to user: Volume tempest-invalid-2126924150 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-18fd7417-3060-4d36-97c5-2cff2bd15838 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2126924150" status: 404 len: 99 microversion: 2.1 time: 0.144791 Oct 15 08:44:48.419393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 19/40] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 08:44:48 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2126924150 => generated 99 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 15 08:44:48.423540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:44:48.423540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:44:48.423540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:44:48.423540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:44:48.423540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:44:48.432869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-42dc2d24-28c8-4eec-bebe-0d7610f3d94c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:48.435189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:48.436054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-42dc2d24-28c8-4eec-bebe-0d7610f3d94c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:48.441382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:48.442139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:48.444043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:48.445065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:48.447192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:48.512074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Getting quotas for project f67051bce2414ff791a2a1e1a638cadc. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:48.526465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Getting quotas for user 9cc9e2cf11804cc39a7de3c314e46679 and project f67051bce2414ff791a2a1e1a638cadc. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:48.544381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-42dc2d24-28c8-4eec-bebe-0d7610f3d94c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:48.575404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:44:48.576834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-42dc2d24-28c8-4eec-bebe-0d7610f3d94c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1237 microversion: 2.1 time: 0.162263 Oct 15 08:44:48.582391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 20/41] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1237 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:48.593165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a8ca377d-6239-409e-9deb-ac9f0422b013 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008720 Oct 15 08:44:48.597098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 21/42] 10.222.0.30 () {58 vars in 1140 bytes} [Sat Oct 15 08:44:48 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 15 08:44:48.598836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:44:48.614519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ae27a4bc-71dc-43a4-9f97-335bd4995340 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008989 Oct 15 08:44:48.617815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 22/43] 10.222.0.30 () {58 vars in 1137 bytes} [Sat Oct 15 08:44:48 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 15 08:44:48.630785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef83da18-5be6-4348-a87b-34d78653a03d tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Calling method '.version_select at 0x7f575b16f0d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:48.718754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-ef83da18-5be6-4348-a87b-34d78653a03d tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] HTTP exception thrown: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef83da18-5be6-4348-a87b-34d78653a03d tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/os-volumes/6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 HTTP/1.1 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:48.721067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '6f3333e2-6bbb-403f-892c-d9ebd31bb1c8'} Oct 15 08:44:48.723010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. (HTTP 404) (Request-ID: req-49217245-6942-4d5d-9169-63151102675f) Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.728327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 08:44:48.729298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 15 08:44:48.730383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef83da18-5be6-4348-a87b-34d78653a03d tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 404 to user: Volume 6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef83da18-5be6-4348-a87b-34d78653a03d tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/6f3333e2-6bbb-403f-892c-d9ebd31bb1c8" status: 404 len: 109 microversion: 2.1 time: 0.097906 Oct 15 08:44:48.731372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 23/44] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:44:48 2022] DELETE /compute/v2.1/os-volumes/6f3333e2-6bbb-403f-892c-d9ebd31bb1c8 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:44:48.732095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-145671d2-450a-4e8a-9220-77676487b8cd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.897787 Oct 15 08:44:48.732095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:44:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:44:48.738816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef2867ff-f1df-40bd-80ff-f2db527d8b31 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Calling method '.version_select at 0x7f575b161a60>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:48.807864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e5e5727-0c1f-4e55-b3ed-2893168b827e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:48.816544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e5e5727-0c1f-4e55-b3ed-2893168b827e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:49.148597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-ef2867ff-f1df-40bd-80ff-f2db527d8b31 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] HTTP exception thrown: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef2867ff-f1df-40bd-80ff-f2db527d8b31 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Request method failure captured: Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/os-volumes/5f4601f3-ff46-4756-80ed-5c04b304ea64 HTTP/1.1 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL7YLD8xW0DJttSYFCRf_4K7yFIgzjyx9F47jGiON2jpD5q-k2HUoVRTCv1A59kBEyMoLItY3W7m58vg1vsexFZoVCPFyfFXMnTyZtZ0OP2KHNBNlZ7YpES-JkhAfm18H8NDnJ7nxbuMQ7JKMhkWmGxoPsuwIJlVgrZpk4fZHDB3l0 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:44:49.150906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/d18c41fc79fe4fd2be58ca56ba77a660"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_d18c41fc79fe4fd2be58ca56ba77a660", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: d18c41fc79fe4fd2be58ca56ba77a660 Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesNegativeTest-448240762 Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2fe5480da9a34418a49c657c90542988 Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesNegativeTest-448240762-project Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '5f4601f3-ff46-4756-80ed-5c04b304ea64'} Oct 15 08:44:49.152017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. (HTTP 404) (Request-ID: req-82ebb59a-4f6d-4b23-89f8-55b704d2a60a) Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:49.152787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 15 08:44:49.153699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 15 08:44:49.154571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef2867ff-f1df-40bd-80ff-f2db527d8b31 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] Returning 404 to user: Volume 5f4601f3-ff46-4756-80ed-5c04b304ea64 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef2867ff-f1df-40bd-80ff-f2db527d8b31 tempest-VolumesNegativeTest-448240762 tempest-VolumesNegativeTest-448240762-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/5f4601f3-ff46-4756-80ed-5c04b304ea64" status: 404 len: 109 microversion: 2.1 time: 0.422938 Oct 15 08:44:49.155456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 24/46] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 08:44:48 2022] GET /compute/v2.1/os-volumes/5f4601f3-ff46-4756-80ed-5c04b304ea64 => generated 109 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:44:49.291557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:49.292174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:49.298826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:49.299333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:49.299766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:49.314108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:49.317478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:49.317989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:49.665917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e5e5727-0c1f-4e55-b3ed-2893168b827e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:49.667948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:49.682638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01e6376b-a924-4de7-bf9d-a0f224209ea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1267 microversion: 2.1 time: 0.394850 Oct 15 08:44:49.688246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 25/47] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:49 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1267 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:44:49.692388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e5e5727-0c1f-4e55-b3ed-2893168b827e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1222 microversion: 2.1 time: 0.946515 Oct 15 08:44:49.708963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1822215430", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea53bcc8-72ba-43b3-b5ba-25a7a79f0091"}], "security_groups": [{"name": "tempest-securitygroup--1486790428"}], "key_name": "tempest-keypair-882221769", "user_data": "}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:44:49.720844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 23/48] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:48 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1222 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:49.739412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:49.740700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:49.749446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:49.750361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:49.751119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:49.751965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:49.752872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:49.753663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:50.187674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:50.208662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d4c1f911-ed53-4144-884a-5b1956c20ff1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1233 microversion: 2.1 time: 0.486303 Oct 15 08:44:50.236169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 24/49] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1233 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:50.315366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] validate_networks() for [('ea53bcc8-72ba-43b3-b5ba-25a7a79f0091', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:44:50.716509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:50.717142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:50.737444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:50.739144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:50.739610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:50.741595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:50.742943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:50.744262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:51.009144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:51.028674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-18385cc4-0e57-4cb6-a5a0-b41d57d9fc2c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1273 microversion: 2.1 time: 0.311088 Oct 15 08:44:51.029660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 25/50] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:50 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:51.041967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:51.047102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:51.077297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:51.085146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:51.086748 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:51.090401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:51.094960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:51.095931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:51.411175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:51.437113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-321eca46-3df5-4136-b70e-3eabd9f9e4c4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1274 microversion: 2.1 time: 0.393655 Oct 15 08:44:51.439309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 26/51] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:51 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1274 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:51.457172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:51.458574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:51.486374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:51.487497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:51.488231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:51.489604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:51.492926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:51.493800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:51.722056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:51.740851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d03aed7f-cb9d-4e14-a02e-7e09cb52c35c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1295 microversion: 2.1 time: 0.299588 Oct 15 08:44:51.758634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 27/52] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1295 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:52.063403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:52.066751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:52.101121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:52.106758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:52.113071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:52.120070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:52.126104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:52.128880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:52.686659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:52.698494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb0f780e-a85c-49a3-b0f8-fcae49229102 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1273 microversion: 2.1 time: 0.648300 Oct 15 08:44:52.724228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 28/53] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:52 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1273 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:52.777323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:52.782190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:52.823699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:52.829029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:52.833814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:52.840414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:52.844941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:52.847243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:54.373753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:54.387807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7285e7ba-f093-457b-90c4-5216e6ca9887 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1280 microversion: 2.1 time: 1.652229 Oct 15 08:44:54.390672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 29/54] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:52 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1280 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:54.412415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:54.413834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:54.437967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:54.439714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:54.442253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:54.447110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:54.447814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:54.449038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:54.860729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:54.883624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f05d4138-eb99-4eb1-858e-d3baae497387 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1295 microversion: 2.1 time: 0.480893 Oct 15 08:44:54.898620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 30/55] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1295 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:54.937543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:54.940101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:54.954895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:54.955826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:54.957959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:54.960729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:54.962657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:54.964304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:57.433636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:57.802830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:44:57.802830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:44:57.802830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:44:57.802830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:44:57.802830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:44:57.812724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:57.813230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:57.813798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:57.814470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:57.815910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:57.816538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:57.847338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for project 23e3a95b1487450cad043a820d321f26. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:44:57.853625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for user 388ca829d87348bd9b524fd9a80e578b and project 23e3a95b1487450cad043a820d321f26. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:44:57.870667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:44:57.875015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:44:57.970036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-59f16533-2a81-4f35-bce9-8e5094eee7f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 8.279715 Oct 15 08:44:57.979193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 26/56] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Oct 15 08:44:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 8290 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 08:44:57.985748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:57.986476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:58.040696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:58.041867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:58.043031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:58.044013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:58.044633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:58.045231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:58.268875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.272136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.280238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-caec43de-271e-4f99-892e-b108a92172c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 3.375136 Oct 15 08:44:58.281144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-887e6cde-d25d-4618-bf4a-6060dfa631cc tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1280 microversion: 2.1 time: 0.300495 Oct 15 08:44:58.293919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 27/57] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:57 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:58.295822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 31/58] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:54 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 3397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:58.316280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:58.317321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:58.322525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:58.327348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:58.341341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:58.342567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:58.347352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:58.348113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:58.350197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:58.351137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:58.430941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.451225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.452730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.453952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cbce9066-4b38-475f-832f-1beec87e2c2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1281 microversion: 2.20 time: 0.157053 Oct 15 08:44:58.454847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 32/59] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:44:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:44:58.869404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:44:58.922636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-315b280f-e4fc-483f-b24c-a210ce9ca08d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.608505 Oct 15 08:44:58.927862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 28/60] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:44:59.309221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:59.310001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:59.323547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:44:59.324558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:44:59.326932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:44:59.338612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:59.341558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:59.344587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:59.345804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:59.347805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:59.349852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:59.352712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:59.354822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:59.357533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:44:59.360524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:44:59.360756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:44:59.361192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:00.546313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:00.559368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-daf0222c-1874-4534-a322-cc6cf071321a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 1.237792 Oct 15 08:45:00.562480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 29/61] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:59 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:00.578695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:00.579466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:00.598910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:00.609038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:00.611609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:00.614153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:00.616121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:00.616564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:00.923407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:00.945388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b454e898-2e90-41bf-9a8b-c7cb450957e2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 1.638932 Oct 15 08:45:00.954634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 33/62] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:44:59 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:00.979491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:00.980472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:00.993668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:00.995217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:00.995795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:00.998271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:00.998775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.000411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.011862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:01.021787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:01.050170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:01.054606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-793df430-4103-43ea-aca9-d42a49a11456 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1333 microversion: 2.20 time: 0.490720 Oct 15 08:45:01.060907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 30/63] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1333 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:01.169257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "425a2fc0-4c28-4213-b32d-21aeb71cbf1f", "tag": "786783e3-cf68-45e2-b461-ea76864aa665"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:01.194965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:01.195564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.196064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.249450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Creating event network-changed:786783e3-cf68-45e2-b461-ea76864aa665 for instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f on hv-cinder-85697 Oct 15 08:45:01.262505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 15 08:45:01.263051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-175df714-e995-4fdf-b819-b55fc8a56081 req-3d8aa987-125f-4da0-95a0-2214752833f2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 15 08:45:01.264279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:01.267423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.267978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.270006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:01.270489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.274378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.301697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.compute.rpcapi [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 15 08:45:01.302958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] Releasing lock "compute-rpcapi-router" {{(pid=125327) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 15 08:45:01.321552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:01.340109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a5c4eb8d-7839-490f-951f-0817ae2267b0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.377680 Oct 15 08:45:01.341145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 34/64] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:01.349477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-711639051", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abd5286e-7177-474d-b9f2-9ade4753e5ec"}], "security_groups": [{"name": "tempest-securitygroup--223686186"}], "key_name": "tempest-keypair-498952549", "user_data": "}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:01.353179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6c5d2866-b9d4-400a-873f-22a51a5fea22 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.290386 Oct 15 08:45:01.354129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 31/65] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:01.589599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:01.590356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:01.609840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:01.610572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.611163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.612171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:01.614768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:01.615393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:01.750182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] validate_networks() for [('abd5286e-7177-474d-b9f2-9ade4753e5ec', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:45:02.208113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:02.219710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2ec56d09-8eb2-4bbf-ae4e-f7b81d41f1f1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.636965 Oct 15 08:45:02.222310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 32/66] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:01 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:02.230627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:02.231181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:02.246231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.246768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.247192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.247890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.248342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.248768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.562670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:02.571285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-78720091-69ef-422b-bbd4-63a7ad7ad585 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.347708 Oct 15 08:45:02.573360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 33/67] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:02 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:02.586968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:02.587624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:02.593619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.594237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.594617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.595314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.596058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.596483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.603626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:45:02.604162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:45:02.604646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:45:02.605249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:45:02.605770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:45:02.622647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.623455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.624069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.625528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.626342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.627464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.649509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:02.655748 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:45:02.661205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:45:02.670372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:02.679138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:02.680070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:45:02.680685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:02.682014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-82ad67a3-2ddd-46e1-a902-8b1c802c3b79 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1333 microversion: 2.20 time: 0.107270 Oct 15 08:45:02.682797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:45:02.697495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 34/68] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:02.752052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-92ebbdec-f66c-4bf3-a7c3-c99eccd39ebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.409701 Oct 15 08:45:02.752847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 35/69] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:45:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:45:02.763674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:02.764525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:02.774874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.776273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.781108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.781912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.782420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.783141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.806550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60a56b6e-d8d1-4f32-b72f-d1d4135779ff", "tag": "3f77bbb2-7bc9-473d-89cb-ab29502af0a6"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:02.827991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:02.830383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:02.831017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:02.876688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] Creating event network-changed:3f77bbb2-7bc9-473d-89cb-ab29502af0a6 for instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff on hv-cinder-85697 Oct 15 08:45:02.884268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-ef8f719e-042a-48fa-90c2-e0f34e435f2e req-1daf497b-b7e8-498d-b74e-5a5bf22f951d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184050 Oct 15 08:45:02.885319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 35/70] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:02.891015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7fa2c964-9c3c-4d2e-9b5f-4127ef1ea0c8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:02.891799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7fa2c964-9c3c-4d2e-9b5f-4127ef1ea0c8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:03.037025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7fa2c964-9c3c-4d2e-9b5f-4127ef1ea0c8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:03.052693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7fa2c964-9c3c-4d2e-9b5f-4127ef1ea0c8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1240 microversion: 2.1 time: 0.161243 Oct 15 08:45:03.054525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 36/71] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:02 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1240 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:03.075491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:03.084554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-72cd5c1f-0d22-4410-957c-6e2f612f3b37 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.330504 Oct 15 08:45:03.085987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 36/72] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:03.246235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:03.246979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:03.253184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.253695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.254129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.255126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.255587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.256016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.378051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fe6c8c-4787-4c73-8993-3bcb42cf1e4a", "tag": "3b5d8ee5-126d-4bd3-a3d0-928e5922b384"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:03.430341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.431850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.432688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.463078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Creating event network-changed:3b5d8ee5-126d-4bd3-a3d0-928e5922b384 for instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a on hv-cinder-85697 Oct 15 08:45:03.463769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 15 08:45:03.464301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4a1139a2-6388-40b3-b4b5-86d8fc0b2cdf req-dc511e68-9629-4137-a3f5-dc8ec8475a9a service nova] Acquired lock "compute-rpcapi-router" {{(pid=125329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 15 08:45:03.466221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.466909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.467490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.468738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.469536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.470291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.493335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.compute.rpcapi [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 15 08:45:03.497286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] Releasing lock "compute-rpcapi-router" {{(pid=125329) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 15 08:45:03.525890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c9d70262-c04c-4be5-b23a-f1197a3ba9a9 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151316 Oct 15 08:45:03.527734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 37/73] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:45:03.596044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:03.596737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:03.608129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.609464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.609464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.611734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.613563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.613895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:03.614356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.626513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f892fb92-8d40-4920-afe5-f139f0c7a17f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.384344 Oct 15 08:45:03.629508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 37/74] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:03 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:03.721556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:03.722271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:03.742552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:03.752495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.753101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.753551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:03.754558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:03.755203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:03.755883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.049358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:04.065737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:04.067279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:04.072967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6e6ecdaa-f894-48c2-bdd4-bcb1582403b3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1333 microversion: 2.20 time: 0.365497 Oct 15 08:45:04.080320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 38/75] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1333 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:04.093797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:04.094714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:04.135796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.136342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.136784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.137566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.138120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.138546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.159376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:04.175690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-049b28ca-f804-4019-bdc0-e1cfcb896b58 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.581232 Oct 15 08:45:04.176975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 38/76] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:03 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:04.188172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:04.191492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:04.207358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.208812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.210387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.212447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.215773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.217971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.482417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:04.498124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8c03d2ec-e4f2-4655-a7c3-d4e335112b5a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1244 microversion: 2.1 time: 0.415816 Oct 15 08:45:04.525423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 39/77] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:04 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1244 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:04.655172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:04.656983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:04.685439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.696498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.697226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:04.702658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:04.703488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:04.704259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.509256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.516919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4013f8c2-8388-4e97-ba0c-8002822b3b71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 1.337996 Oct 15 08:45:05.517483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 39/78] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:05.522007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:05.522615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:05.528632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.529112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.529568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.530314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.530766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.531185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.644517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.648549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.652738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-009c07bd-9d80-4666-acc2-26f01e132013 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 1.004114 Oct 15 08:45:05.653301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 40/79] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:04 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:05.658169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:05.658791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:05.664541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.665029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.665454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.666357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.666829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.667458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.673320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.674790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.675891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8f2b2dc-2f3e-4048-986a-19f70b6f374a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.157466 Oct 15 08:45:05.676432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 40/80] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:05.682391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:05.683001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:05.688888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.689547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.690432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.691283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:05.691875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:05.692436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:05.933073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:05.936827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:05.941899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-75994355-3f64-4524-bc10-042558ffa010 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.264165 Oct 15 08:45:05.942476 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 41/81] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:05 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:06.043702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.052573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c80fb3b9-81b2-4254-ba80-222cc90db87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.397991 Oct 15 08:45:06.053183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 41/82] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:05 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:06.359896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a", "tag": "b6bb83b5-c727-4796-a835-696ea9d3ca06"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:06.371365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.372072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.372523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.384436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] Creating event network-changed:b6bb83b5-c727-4796-a835-696ea9d3ca06 for instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a on hv-cinder-85697 Oct 15 08:45:06.389737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-24e51993-522a-4edf-9dce-7623e4766a7b req-36cb68d0-12cf-4652-af4b-53478b8eec16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035582 Oct 15 08:45:06.390330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 42/83] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:06.540867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:06.541651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:06.548367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.548937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.549490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.550300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.550760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.551186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.569336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:06.677321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:06.678290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:06.687946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.688782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.689443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.691305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.692077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.692668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.703208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.713868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d2571efc-6855-4230-b100-de38cd681760 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.177664 Oct 15 08:45:06.714742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 42/84] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:06.719695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:06.720537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:06.726606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.727285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.727869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.728882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.729610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.730219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.827218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.840163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.842001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.843187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ede91b3c-8e97-4fec-bbeb-9dfb8dc40c03 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.127368 Oct 15 08:45:06.858089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 43/85] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:06.895101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:06.903359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a1fb9797-c984-43c1-a8e0-191a831c5207 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.230150 Oct 15 08:45:06.903744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 43/86] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:06 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:06.964858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:06.965456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:06.972369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.972841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.973263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:06.973959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:06.974403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:06.974815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.034906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.043172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4fdeeda2-4bb6-4c45-9392-468a6edbf76c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.082649 Oct 15 08:45:07.043716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 44/87] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:06 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:07.075869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:07.076475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:07.082334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.082812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.083243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.083918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.084367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.084786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.215455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.222936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-282df0e4-480b-490e-adf8-29249d3dae20 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.150962 Oct 15 08:45:07.223492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 44/88] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:07 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:07.736863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:07.737448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:07.743839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.744320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.744752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.745437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.745919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.746341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.870485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:07.871719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:07.872660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.880826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.881016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-862e1c92-81e7-4a27-bd6e-ad1362b6392f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.148003 Oct 15 08:45:07.881637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.882237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.883676 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.884119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.884705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.897093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 45/89] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:07.927104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:07.927912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:07.937073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.937816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.938592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.939520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:07.939996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:07.940571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:07.976642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.985312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.987003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:07.988058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bc5d8306-23c8-4ddf-848a-9e46f5bcbdbd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.122006 Oct 15 08:45:07.989100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 45/90] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:08.071967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:08.072698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:08.088455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.089118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.089655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:08.090511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.091205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.091736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:08.177399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:08.178406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:08.187506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f35eae84-7b2d-47f2-bf1a-f390a353f967 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.264649 Oct 15 08:45:08.191018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d222ca9-f286-4986-a19b-ef3eed8a54c3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.127277 Oct 15 08:45:08.191594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 46/91] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:08 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:08.202204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 46/92] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:07 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:08.247597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:08.248223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:08.254818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.255308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.255740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:08.256467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.257042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.257461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:08.400157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:08.408292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-00138bd6-bfa1-4b9e-9efa-20b1bf5862c0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.164951 Oct 15 08:45:08.408846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 47/93] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:08 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:08.904872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:08.905483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:08.911506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.911988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.912421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:08.913142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:08.913594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:08.914045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.020146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:09.021426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:09.028600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.029287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.029934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.030771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.031364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.031926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.095465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.104343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4edbb535-6736-4e7f-98d0-dc056f20729a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.203164 Oct 15 08:45:09.119174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 47/94] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:09.122744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.135438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.138460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.139973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-26fe1c5b-b938-41b7-a892-db7738aa7424 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.123758 Oct 15 08:45:09.140567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 48/95] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:09 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:09.212950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:09.213615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:09.214400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:09.215013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:09.219992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.220493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.220924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.221846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.222308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.222665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.222777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.223144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.223570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.224248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.224736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.226981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.318599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.328887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-65a376a4-1dfc-44dc-a38d-76d1522f4c4a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.118690 Oct 15 08:45:09.329373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 49/96] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:09 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:09.382444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.390772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-af67cce5-f285-4cbf-b145-d40affa1b5c6 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.183105 Oct 15 08:45:09.391331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 48/97] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:09 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:09.431869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:09.432484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:09.438560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.439044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.439481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.440164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:09.440619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:09.441040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:09.567927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:09.576094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5631e787-68f6-41f1-a3ec-1b06eaa822f1 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.148645 Oct 15 08:45:09.576663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 50/98] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:09 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:10.128293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:10.128894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:10.135521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.136001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.136423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.137123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.137572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.138004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.165819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:10.166525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:10.172631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.173185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.173712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.174474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.175003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.175490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.252549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.261195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.262658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.263752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e1f550c5-e199-4f26-88df-9cf2474999f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.102367 Oct 15 08:45:10.264306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 51/99] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:10 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:10.281922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.289647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9d1c6d60-b319-4b93-97ee-9f90728948fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.165201 Oct 15 08:45:10.290226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 49/100] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:10.351878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:10.352487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:10.358423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.358924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.359350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.360025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.360476 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.360892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.413078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:10.413704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:10.420853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.421348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.421919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.422614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.423186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.423473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.426402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.436992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e31d3d25-2331-4037-b69f-95861cba4b9a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.089343 Oct 15 08:45:10.442662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 52/101] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:10 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:10.549846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.558037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f464615-b446-476d-a746-70d509974a2f tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.148744 Oct 15 08:45:10.558589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 50/102] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:10 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:10.598073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:10.598685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:10.605019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.605487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.605939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.606609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:10.607053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:10.607463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:10.730641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:10.738176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9ad320a1-6f3f-4326-ab85-cee6fbd087c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.143842 Oct 15 08:45:10.738757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 53/103] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:10 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:11.294484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:11.295094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:11.296914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:11.302392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.302856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.303283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.303962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.304429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.304856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.311747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:11.312435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:11.318735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.319764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.319764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.320989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.321502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.321950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.371140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.380536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.382381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.384314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8d5f31c4-5c64-42f7-b49e-e377f7eda930 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.093680 Oct 15 08:45:11.384943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 51/104] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:11.468444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:11.468444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:11.474574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.474747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.475078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.475515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.476198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.476791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.477387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.483649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e8b85482-c1f4-4a28-8ddb-0975bf880ac4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.175577 Oct 15 08:45:11.485423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 54/105] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:11.550122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.560434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fcff9a49-d7e9-458c-8b70-d4859c10e876 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.103258 Oct 15 08:45:11.561449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 52/106] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:11 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:11.580657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:11.581271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:11.588830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.589325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.589782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.590493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.590940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.591361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.747529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.755545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-69e0e826-0817-437f-bade-9b52a629477b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.179032 Oct 15 08:45:11.756180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 55/107] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:11 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:11.760372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:11.760983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:11.766953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.767431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.767858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.768535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:11.768987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:11.769406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:11.891811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:11.899534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-378d203e-7afd-42b3-8362-a6fe8184aa47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.143451 Oct 15 08:45:11.900085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 53/108] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:11 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:12.409088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:12.409834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:12.416616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.417090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.417511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.418208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.418654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.419067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.478543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.486505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.487921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.489002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c2da30b2-b1d9-4322-97ac-19a14ca18e1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.083797 Oct 15 08:45:12.489559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 56/109] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:12.507371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:12.508190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:12.514166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.514647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.515080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.515763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.516217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.516637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.584591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:12.585223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:12.591697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.592170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.592594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.593266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.593728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.594143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.664787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.669188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.672712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c3721a2f-77cb-44f4-9535-9ed6e5d68e3d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.091910 Oct 15 08:45:12.677300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01841dc9-fb6e-422a-ab36-9af1aebd4af7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.173771 Oct 15 08:45:12.677884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 54/110] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:12.688415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 57/111] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:12 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:12.778916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:12.779519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:12.785329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.785839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.786265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.786936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.787381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.787795 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.911219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:12.919260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9210b498-21a9-4e31-b742-0ae8c9b400a9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.144061 Oct 15 08:45:12.919815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 55/112] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:12 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:12.922100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:12.922718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:12.924665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=34 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:12.929918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.930406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.930843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:12.931529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:12.931982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:12.932402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.059289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.066825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-01884e7f-8c1f-405b-83c7-9a0391cd1716 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.148542 Oct 15 08:45:13.067392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 58/113] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:12 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:13.513960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:13.514591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:13.516407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=22 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:13.522177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.522661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.523112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.523817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.524546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.524970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.585000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.593010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.594496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.595585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6f78c1b5-a46e-41d9-92f1-045fb1027988 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1339 microversion: 2.20 time: 0.085699 Oct 15 08:45:13.596133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 56/114] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:13.696196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:13.696803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:13.698673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:13.699491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:13.700379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:13.704028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.704584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.705013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.705715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.706163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.706255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.706849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.706958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.707149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.707820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.708268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.708684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.711552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:13.802439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.810354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6ee0dd23-4773-4ee1-8a22-f30c3db3e884 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1292 microversion: 2.1 time: 0.118269 Oct 15 08:45:13.811546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 59/115] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:13 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1292 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:13.864034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:13.878896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-00ce2356-8711-42db-b492-f7c43753b35b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.182994 Oct 15 08:45:13.894478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 57/116] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:13.942908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:13.943699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:13.951537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.951927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.952711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:13.953484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:13.954031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:13.954665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.090788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:14.092417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:14.100535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.101045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.101480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.102253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.102829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.103256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.534433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.546362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-16e97b3d-ecfe-4fad-9f41-9a71a347cea8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.608335 Oct 15 08:45:14.550246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 60/117] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:13 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:14.554866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.563941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-074c2563-2893-4213-abc5-ecd8b3c4048d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.477134 Oct 15 08:45:14.565058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 58/118] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:14 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:14.620365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:14.620977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:14.627005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.627479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.627906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.628581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.629025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.629454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.761970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.770170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.771594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.772717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-31494405-2c1c-4ffe-9348-f8f6d6823dfb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.156200 Oct 15 08:45:14.773779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 61/119] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:14.832267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:14.832901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:14.839422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.839853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.840281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.840958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.841563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.842015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.845868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:14.909319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:14.913291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:14.913937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:14.916932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7e5bba8f-c6df-4a84-a1ac-bd5cfb91f871 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1310 microversion: 2.1 time: 0.088496 Oct 15 08:45:14.917489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 59/120] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:14 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:14.919969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.920450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.920879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:14.921564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:14.922055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:14.922477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.046561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.054041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5c69fc74-a819-4074-abca-5e325a0de032 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.151309 Oct 15 08:45:15.054826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 62/121] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:15.573105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:15.573741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:15.579660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.580128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.580551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.581225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.581666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.582104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.585959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:15.586571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:15.592545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.593024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.593454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.594170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.594618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.595038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.776390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.781746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.784249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0dc0eedc-d498-455b-bdc2-8ddc8282695a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.215495 Oct 15 08:45:15.784818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 60/122] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:15 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:15.794425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e60898ae-8f9c-45ce-8436-5e08b2db6aad tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.212242 Oct 15 08:45:15.795134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 63/123] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:15 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:15.799407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:15.800171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:15.806807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.807357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.807854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.808606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.809122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.809629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.933416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.939679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:15.940310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:15.942534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.944203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:15.945326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3315acd9-e67c-4322-8e2e-3c8904fd71bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.150052 Oct 15 08:45:15.946087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 61/124] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:15 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:15.946531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.947015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.947440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:15.948154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:15.948602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:15.949022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.013530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:16.021098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6c2e0e99-8bf1-45bf-bc3d-e2eef0eea7c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1310 microversion: 2.1 time: 0.085425 Oct 15 08:45:16.021637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 64/125] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:15 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:16.076578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:16.077180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:16.083013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.083489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.083913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.084590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.085039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.085456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.211437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:16.219032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ace6dbcf-8c6e-48fc-ba0f-d553be73a905 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.146291 Oct 15 08:45:16.219590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 62/126] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:16.807275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:16.807913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:16.813965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.814442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.814869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.815555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.816003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.816450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:16.816822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.816971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:16.823961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.824441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.824865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:16.825540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:16.826020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:16.826431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.001650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.009895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.011464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3dc43b3d-13a9-42de-9eea-9a7a729e3cdb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.208534 Oct 15 08:45:17.012278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 65/127] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:16 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:17.016798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:17.017286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:17.023231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.023900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.024591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.025268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.025890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.026444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.026561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cee03713-e96b-45d3-b826-edb3b9138538 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.213979 Oct 15 08:45:17.027669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 63/128] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:16 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:17.045043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:17.045693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:17.052332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.052892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.053389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.054180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.055221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.055770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.125702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.133286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3f84b6de-6bd7-4c86-b816-54c58713d615 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1310 microversion: 2.1 time: 0.092659 Oct 15 08:45:17.133872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 64/129] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:17 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:17.187022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.196396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.197919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.199009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4a00cf97-4db2-4bbd-9170-c04d250b9fe1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.185925 Oct 15 08:45:17.199554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 66/130] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:17.241405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:17.242633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:17.248464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.248931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.249352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.250047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:17.250489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:17.250900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:17.376078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:17.383657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-67557d40-d4cf-460a-ba8f-2c5ad20301e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.146051 Oct 15 08:45:17.384423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 65/131] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:18.034842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:18.036239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:18.050544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:18.051964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:18.066639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.067291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.068122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.068778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.069488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.071384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.072240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.072556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.073462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.074115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.074797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.076573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.895274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:18.911730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f788f7cd-bc66-479d-90a0-0b4d3ed44b98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.865729 Oct 15 08:45:18.915405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 66/132] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:18 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:18.918802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:18.922831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:18.924103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:18.935405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.936176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6023cc2d-0444-42ab-9d06-a2e1d7568afa tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.905376 Oct 15 08:45:18.936865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 67/133] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:18 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:18.937711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.938605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.939518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:18.940284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:18.940849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:18.961697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:18.963578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:19.000756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.004573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.005172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.006041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.008270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.009594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.167237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:19.191794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-81544953-1fbf-4bcd-88fd-633fab12c508 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1298 microversion: 2.1 time: 0.274143 Oct 15 08:45:19.209830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 67/134] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:18 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1298 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:19.218318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:19.219381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:19.227124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.229238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.229931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.230886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.231564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.232184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.715219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:19.737465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:19.748792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:19.754153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b9a0a915-94fe-424c-8992-013cdeea6982 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.813245 Oct 15 08:45:19.759987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 68/135] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:19.783877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:19.812460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.813742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.814324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.830668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] Creating event network-changed:3717c011-fe4a-413f-b1ef-15aff3def419 for instance 5a4919f4-824b-4aec-8131-eabe4e8995df on hv-cinder-85697 Oct 15 08:45:19.837265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-d8963123-e5d2-433d-b86b-2902c2e70419 req-6bc039bf-3c36-48dd-8b32-09f8e87da788 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075098 Oct 15 08:45:19.840120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 69/136] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:19.937285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:19.938020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:19.950811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.951328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.951768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:19.954512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:19.962439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:19.963144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.049589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.058762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0227e60c-668b-4aae-84ee-6876facf0400 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.847420 Oct 15 08:45:20.059334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 68/137] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:20.065771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:20.066595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:20.073779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.074436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.075025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.075844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.076294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.076873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.322837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.341118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e4867f90-e8b9-4cc7-b8ab-b2d473361ba6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.407901 Oct 15 08:45:20.342425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 70/138] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:19 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:20.349445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:20.350514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:20.360059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.360899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.361350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.362288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.362405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.363015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.363570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.373230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5ea62264-12e4-489b-bf12-7aa2e497c6b1 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.312468 Oct 15 08:45:20.374116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 69/139] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:20 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:20.521629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.530140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8bb0297-38c5-46ad-8c85-56eac1e4a5e9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.186531 Oct 15 08:45:20.530712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 71/140] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:20 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:20.784297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:20.784933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:20.791401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.791880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.792314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.792996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:20.793447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:20.793902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:20.941169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.950270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.952488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:20.954006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-12933211-7943-4ca1-b43b-3592a1caa95b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.173558 Oct 15 08:45:20.954697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 70/141] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:21.082179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:21.084380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:21.090613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.091099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.091529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.092517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.092979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.106955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.274783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:21.282887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7fac7086-c8d9-4193-b739-d2cbc2cdf4f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.205061 Oct 15 08:45:21.283459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 72/142] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:21.367480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:21.368174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:21.374689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.375173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.375703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.376391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.376843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.377262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.397418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:21.398342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:21.405113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.405599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.406069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.406764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.407328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.407758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.580264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:21.589979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-75dbee3d-e1d2-4591-8c06-19b2c88fc130 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.226664 Oct 15 08:45:21.590634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 71/143] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:21 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:21.593084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:21.596810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:21.597421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:21.603436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0707059b-b492-46e2-a2cb-781f4ae24d9b tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.209691 Oct 15 08:45:21.604161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 73/144] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:21 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:21.611202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.611714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.612139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.612825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.613269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.613699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.747900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:21.755491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cc8b0c55-e989-4a93-9ab7-f93a57ffabae tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.163649 Oct 15 08:45:21.756084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 72/145] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:21 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:21.980566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:21.981174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:21.987185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.987660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.988088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:21.988764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:21.989214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:21.989631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.118720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:22.127250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:22.128948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:22.130215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c1568c1d-5868-424e-8a6a-1cc1f65e0c21 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.154076 Oct 15 08:45:22.130842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 74/146] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:22.304635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:22.305356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:22.312065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.312670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.313197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.314351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.315419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.315977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.459576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:22.468667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-87b91a30-6e16-4b2f-8fdb-5ad10853d096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.167917 Oct 15 08:45:22.469482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 73/147] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:22.613705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:22.614420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:22.620511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.621102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.621621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.622585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.623118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.623547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.627879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:22.628622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:22.635262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.635693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.636086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:22.636804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:22.637253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:22.637716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.011621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.017331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.032289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b59e4422-778d-4d9f-a253-d843fc85078c tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.408460 Oct 15 08:45:23.033477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-38e25033-359e-426d-8ab9-3908d6639c4e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.423483 Oct 15 08:45:23.045750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 74/148] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:22 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:23.045924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 75/149] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:22 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:23.046013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:23.046013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:23.046471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.047225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.047863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.048761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.049404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.050053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.155211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:23.156369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:23.162679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.163371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.164473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.165303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.165914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.166461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.195407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:23.340193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.343186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:23.365190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-18ca9734-f41b-405e-a024-ac95794c2130 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.328758 Oct 15 08:45:23.366047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 75/150] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:23 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:23.452503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.474580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.476879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.480014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ceac7dbb-8657-441b-a8be-a2a520a74a66 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.328661 Oct 15 08:45:23.480591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 76/151] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:23.490896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:23.492620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:23.507970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.509283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.510345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.511485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.512333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.514423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.780620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425a2fc0-4c28-4213-b32d-21aeb71cbf1f", "name": "network-vif-plugged", "status": "completed", "tag": "786783e3-cf68-45e2-b461-ea76864aa665"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:23.792750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:23.793494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:23.794155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:23.808072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] Creating event network-vif-plugged:786783e3-cf68-45e2-b461-ea76864aa665 for instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f on hv-cinder-85697 Oct 15 08:45:23.813888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-7f710586-bd7a-47db-9062-592e2f33eb42 req-cfed3030-ca68-4514-88a0-ee81e7d7717b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186546 Oct 15 08:45:23.819342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 77/152] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:45:23.891713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:23.901851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-58750831-5a10-4397-b9b7-34e273e62d49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.414769 Oct 15 08:45:23.903405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 76/153] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:24.026567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28480cd2-5ae8-4292-9c17-be983439b53f", "tag": "e3f7288d-02e9-4885-aec1-fcc6483c4bb1"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:24.039863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.040414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.040915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.054874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] Creating event network-changed:e3f7288d-02e9-4885-aec1-fcc6483c4bb1 for instance 28480cd2-5ae8-4292-9c17-be983439b53f on hv-cinder-85697 Oct 15 08:45:24.056783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:24.057610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:24.060550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-b63a547d-f80c-4965-a46f-3e079ecb22a2 req-ae780dd0-8075-44f4-be7f-57ae88012428 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042232 Oct 15 08:45:24.062040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 78/154] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:24.067118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.068196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.068581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:24.069236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.069362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:24.071279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.071806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.072436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.076774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.077269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.077801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.078943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.079553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.080137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.273079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.283847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.288167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2e2db834-94e2-42dc-bc6e-8b95347923d0 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.224781 Oct 15 08:45:24.300158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 79/155] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:24 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:24.300455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8f90715a-e134-47c0-88d6-2fbb047972de tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.239021 Oct 15 08:45:24.300455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 77/156] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:24 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:24.389247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:24.390342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:24.393580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:24.397497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.398030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.398460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.399152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.400086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.400330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.504495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:24.505856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:24.512844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.513429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.514204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.515148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.515696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.516227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.535069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.543631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-75524f54-78e7-4048-9efc-3402b554f493 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.158424 Oct 15 08:45:24.546961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 80/157] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:24 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:24.648727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.657439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.658904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:24.660039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-83090e88-dcdb-4558-b3ce-0eb6096fb19f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.159554 Oct 15 08:45:24.660578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 78/158] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:24.924027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:24.924715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:24.931138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.931612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.932155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:24.932705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:24.933156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:24.933571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.270381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.278684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-099958f3-38fe-4112-b7bb-a5d8a5a46658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.358318 Oct 15 08:45:25.279394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 81/159] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:25.310966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:25.311595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:25.317768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.318251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.318674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.319075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:25.319350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.319717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:25.320414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.320832 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.326822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.327308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.327877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.328571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.329025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.329445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.520995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.524980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.529665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-021f20f0-08b2-4fbe-881c-709651beb41d tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.222440 Oct 15 08:45:25.530472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 79/160] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:25 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:25.537418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-683c285f-6e99-4308-a6f0-0198c976df2f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.222291 Oct 15 08:45:25.538018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 82/161] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:25 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:25.566722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:25.567321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:25.573006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.573475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.573931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.574602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.575050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.575465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.687460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:25.688544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:25.695688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.696702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.697276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.698154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:25.698754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:25.699391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:25.728362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.745432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-90a8d3c9-d418-49df-8001-6d92fdb53522 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.182301 Oct 15 08:45:25.750619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 80/162] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:25 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:25.859987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.869773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.871464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:25.872929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f6ed2da8-1256-4762-9612-4d4530523926 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.191790 Oct 15 08:45:25.873563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 83/163] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:26.300216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:26.300822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:26.306791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.307264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.307689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.308363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.308812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.309230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.435645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:26.443254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ae2078aa-fef3-40ce-80dc-2cd8ed8e5f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.146874 Oct 15 08:45:26.443820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 81/164] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:26.553463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:26.554688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:26.560353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:26.560760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.560948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:26.561095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.561528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.562237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.562692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.563109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.566712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.567187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.567615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.568282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.568901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.569317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.752270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:26.759736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:26.760391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-659c0d31-428d-433f-afd6-6e98ff089de5 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.210749 Oct 15 08:45:26.762349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 84/165] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:26 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:26.768121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-05d6bbdb-566a-44d6-8f7f-14a7d43cd2ce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.211406 Oct 15 08:45:26.768909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 82/166] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:26 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:26.772740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:26.773421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:26.779721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.780195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.780620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.781332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.781800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.782222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.899107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:26.900764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:26.908010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.908659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.909102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.910432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:26.910897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:26.911319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:26.921022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:26.931831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6f09ebe2-51da-498d-b3c2-6f4e4d45d212 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.160357 Oct 15 08:45:26.931831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 85/167] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:26 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:27.350023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:27.361869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:27.363310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:27.364421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6c63e99d-bc1b-4912-b903-64cc25dbdc47 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.470415 Oct 15 08:45:27.364980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 83/168] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:27.466468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:27.467077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:27.482704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.483364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.483961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:27.484993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.485594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.486403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:27.766622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:27.780805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3af82a83-c777-48f8-8165-06732fe689f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.317093 Oct 15 08:45:27.781395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 86/169] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:27.783947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:27.786202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:27.794706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.795175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.795613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:27.796317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.796771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.797196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:27.800846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:27.801642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:27.826706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.827355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.827933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:27.828782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:27.829412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:27.830006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.107642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.118011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dd71772b-bb30-456b-bff1-7e4b0bf45ff2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.337337 Oct 15 08:45:28.119287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 84/170] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:27 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:28.124344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:28.125193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:28.131381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.132030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.132955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.133822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.134448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.135012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.135882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.144097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-82c0470d-e20a-4060-b9b2-482c3a644c2e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.349231 Oct 15 08:45:28.145015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 87/171] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:27 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:28.150343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe6c8c-4787-4c73-8993-3bcb42cf1e4a", "name": "network-vif-plugged", "status": "completed", "tag": "3b5d8ee5-126d-4bd3-a3d0-928e5922b384"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:28.159539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.160011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.160431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.173370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] Creating event network-vif-plugged:3b5d8ee5-126d-4bd3-a3d0-928e5922b384 for instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a on hv-cinder-85697 Oct 15 08:45:28.183477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-b8e7a100-1376-422d-b377-a0fc2dc40332 req-06382809-b32a-4254-9bff-54825602ac81 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037271 Oct 15 08:45:28.184274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 88/172] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:28.276931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.284684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-418abaf3-2fce-49e0-be3e-d44e16f39588 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.164095 Oct 15 08:45:28.285244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 85/173] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:28 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:28.391974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:28.392662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:28.399997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.400667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.401242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.402379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.402776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.403226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.542097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.550203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.551636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.552733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-76809909-3b68-456e-a9bf-86208bb1fc0f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.164814 Oct 15 08:45:28.553288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 89/174] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:28.807950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:28.808590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:28.814512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.815001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.815433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.816130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:28.816568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:28.816995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:28.943629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:28.951825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0df8f8a6-9bac-4fea-999a-8ac801112b36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.148185 Oct 15 08:45:28.952385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 86/175] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:29.140016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:29.140622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:29.146462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.147931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.147931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.148568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.149014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.149714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.168736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:29.169356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:29.175201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.175674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.176098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.176766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.177213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.177631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.346339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.349253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.354907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb9c9281-85cb-4fda-91f8-3ed178f84707 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.218537 Oct 15 08:45:29.355663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 90/176] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:29 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:29.357730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6e1908f4-c18b-404f-ad0e-5c9f8a257a60 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.192745 Oct 15 08:45:29.358425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 87/177] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:29 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:29.360048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:29.360647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:29.367945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.368560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.369094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.369920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.370470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.370963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.498828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.506700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4a85d93f-9d6e-46f7-91bf-3180a8183d63 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.150222 Oct 15 08:45:29.507325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 91/178] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:29 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:29.576997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:29.577821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:29.579608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:29.584828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.585825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.586256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.586925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.587366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.587784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.709856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.718440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.719865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:29.720949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b1a90c11-b9f5-4355-b4ef-5c7ee5de712e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.147871 Oct 15 08:45:29.721494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 88/179] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:29.974448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:29.975063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:29.981356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.982038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.982364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:29.983093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:29.983550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:29.983979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.112767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.120958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-df4cc4ba-9224-405a-8da0-ed15bb204b58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.150631 Oct 15 08:45:30.121525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 92/180] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:30.378130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:30.378740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:30.380265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:30.380881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:30.384958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.385446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.385929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.386649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.387130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.387235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.387601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.387704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.388161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.388853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.389315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.389757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.583703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.587619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.592226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e309d319-358f-4da4-a463-31f932fe86fb tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.217948 Oct 15 08:45:30.592859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 89/181] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:30 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:30.595427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a4b5fbe0-92f4-42ff-ba09-8905c7d26f43 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.218912 Oct 15 08:45:30.596137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 93/182] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:30 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:30.597421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:30.598158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:30.603933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.604505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.605027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.605826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.606491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.606974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.735680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.745445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-627aad66-2c38-4ec5-810e-b42e4be1d9d2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.151528 Oct 15 08:45:30.746652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 90/183] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:30 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:30.751183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:30.752197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:30.764344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.764887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.765394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.766116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:30.766716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:30.767186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:30.919527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.928335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.929946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:30.931107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4f091ebe-4271-4117-ac1c-b59f805e8cb7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.188329 Oct 15 08:45:30.931658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 94/184] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:30 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:31.143425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:31.144067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:31.150406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.150888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.151319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.151999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.152452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.152873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.280804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:31.298954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8344c126-759e-4497-a1f2-9d0e809fd36a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.159227 Oct 15 08:45:31.299532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 91/185] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:31.617897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:31.618451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:31.618834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:31.619382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:31.625066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.625422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.626051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.627075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.627531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.627976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.630031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.630630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.631581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.632538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:31.633154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:31.633614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:31.638489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:31.651315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:32.181938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.195433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84e9f091-9437-4f01-b102-4eaa0d98a733 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.581216 Oct 15 08:45:32.201930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 92/186] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:31 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:32.205945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:32.206612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:32.214111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.214599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.215190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.216157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.216771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.217286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.233598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.243766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0653d00a-23e7-4338-bd63-c45c3eb49f3a tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1315 microversion: 2.1 time: 0.632310 Oct 15 08:45:32.261903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 95/187] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:31 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:32.267568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:32.268394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:32.276067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.276747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.277468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.278485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.279086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.279696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.421411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.440689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4b2fca5b-d079-4ffc-b08d-9f0a13704bca tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.242320 Oct 15 08:45:32.442553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 93/188] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:32 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:32.450402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:32.451251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:32.463856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.464575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.465170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.466191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.466839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.467727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.639032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.655637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.657078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.658472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-81b01ac3-e287-4147-bb7e-711122496bc1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.395258 Oct 15 08:45:32.670437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 96/189] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:32.828744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:32.837644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-370037c1-ad00-4760-a2b4-c96caadf16bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1363 microversion: 2.1 time: 0.393561 Oct 15 08:45:32.838324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 94/190] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:32.893194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a56b6e-d8d1-4f32-b72f-d1d4135779ff", "name": "network-vif-plugged", "status": "completed", "tag": "3f77bbb2-7bc9-473d-89cb-ab29502af0a6"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:32.903992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:32.904461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:32.904878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:32.916853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] Creating event network-vif-plugged:3f77bbb2-7bc9-473d-89cb-ab29502af0a6 for instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff on hv-cinder-85697 Oct 15 08:45:32.923733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-48e62502-8a69-496f-9cce-5e30917f7c10 req-67678c2a-1705-4cc9-b5e6-b3f601768a87 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Oct 15 08:45:32.924645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 97/191] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:33.223131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:33.223747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:33.235530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.236022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.236463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.237166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.237618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.239420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.269239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:33.270201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:33.292061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.292821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.293428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.294384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.294981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.295554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.566847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:33.570699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:33.578922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-72623e45-ecf8-4b1a-8f89-6df2a64e5c48 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1502 microversion: 2.1 time: 0.314105 Oct 15 08:45:33.579279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a7c474c6-d304-415d-95e0-141c8b1ecd47 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.359330 Oct 15 08:45:33.579492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 98/192] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:33 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:33.584137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:33.584973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:33.591152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 95/193] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:33 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:33.592256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.592937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.593541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.594443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.595061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.595649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.700908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:33.701511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:33.711628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.712113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.715651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:33.717920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:33.719063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:33.719537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.048685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.054384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.063209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bff102a4-05f2-428d-88d0-35477ad3477d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.482420 Oct 15 08:45:34.063773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.065307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.068580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ba075e5d-2b03-40f0-a2ad-4e57e99ad0d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.372009 Oct 15 08:45:34.079793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 96/194] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:34.081571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 99/195] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:33 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:34.112518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:34.114470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:34.133042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.135889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.136344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.137904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.141126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.142827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.355709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.365565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-467895d3-4be7-4f2f-af6a-3e68f3dca207 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1549 microversion: 2.1 time: 0.277889 Oct 15 08:45:34.366182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 97/196] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1549 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:34.392690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:34.393237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:34.400739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.401517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.402123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.402971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.404253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.404870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.531400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d13865fc-c9b3-4ab5-9cca-991cba889a6b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142779 Oct 15 08:45:34.532152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 100/197] 10.222.0.30 () {58 vars in 1275 bytes} [Sat Oct 15 08:45:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:34.607211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:34.608030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:34.619156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.620076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.620809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.622010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:34.622751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:34.623595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:34.922821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:34.931122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f39b5bd7-132c-407f-9451-a03e07a17656 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.328587 Oct 15 08:45:34.942347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 98/198] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:34 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:35.091804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:35.093367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:35.096872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:35.098090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:35.102603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:35.103024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:35.103825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:35.104704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:35.105354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:35.106052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:35.107508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:35.107508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:35.107896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:35.108741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:35.109345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:35.109939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:35.959699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:35.976494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:35.982231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:35.985839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-363357aa-529f-4bd8-b465-4e7b60ab86f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.893151 Oct 15 08:45:35.986417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 99/199] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:35.995110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ce84a61-1cf5-4501-882d-371975117a75"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:36.003771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:36.018333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.018818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.023356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.024301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.026513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.029840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.158843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:36.173923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-06873a7a-01fb-410e-bd04-50b2b393a3b2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 1.088040 Oct 15 08:45:36.174553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 101/200] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:35 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:36.185812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a", "name": "network-vif-plugged", "status": "completed", "tag": "b6bb83b5-c727-4796-a835-696ea9d3ca06"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:36.193359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.194178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.195152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.207987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] Creating event network-vif-plugged:b6bb83b5-c727-4796-a835-696ea9d3ca06 for instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a on hv-cinder-85697 Oct 15 08:45:36.214781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-76b6b30f-f95d-40a2-9b60-bd7115c0fff4 req-3e51faf7-155c-4f81-a843-e1864f0827a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038157 Oct 15 08:45:36.215927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 102/201] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:36.221584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:36.222314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:36.229447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.230212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.230877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.231753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.232355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.233070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.481200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:36.492706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-79d9cce6-546e-4ff4-a6e3-693aa38fc066 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.275078 Oct 15 08:45:36.506240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 103/202] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:36 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:36.901343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fe6c8c-4787-4c73-8993-3bcb42cf1e4a", "tag": "3b5d8ee5-126d-4bd3-a3d0-928e5922b384"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:36.923803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:36.924479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:36.929545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:36.969365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] Creating event network-changed:3b5d8ee5-126d-4bd3-a3d0-928e5922b384 for instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a on hv-cinder-85697 Oct 15 08:45:36.979925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-b8aae500-cb5d-4700-a164-524897e6fdd6 req-965ff1a9-2ffb-4d8e-b1ad-a6b70cdb3ea5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082654 Oct 15 08:45:36.982782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 104/203] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:45:37.020551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:37.022490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:37.043544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.044714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.047911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.050377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.052440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.053714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.351593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:37.364998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-98a956c8-8e0d-466b-9c55-46d9919833dd tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "POST /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.373815 Oct 15 08:45:37.365627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 100/204] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 08:45:35 2022] POST /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f/os-volume_attachments => generated 194 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:37.369270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:37.373318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:37.376412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-719e36be-5c71-432a-94a8-5f31c39a2aa9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.361463 Oct 15 08:45:37.378440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 105/205] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:37 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:37.388711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:37.389878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:37.422693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.423856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.425930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.427752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.430279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.431660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.517971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:37.519395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:37.530550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.533300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.534523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.546366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:37.549776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:37.551721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:37.630635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:37.640523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5cbf1534-5322-4ab7-abf7-a3ab5d7d7f55 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.273639 Oct 15 08:45:37.642073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 101/206] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:37 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:38.110706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:38.121327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-64445900-efaf-4c6d-84af-290518dd87a5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.607523 Oct 15 08:45:38.123370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 106/207] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:37 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:38.236454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "name": "network-vif-plugged", "status": "completed", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:38.254385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:38.255036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:38.255637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:38.268847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] Creating event network-vif-plugged:3717c011-fe4a-413f-b1ef-15aff3def419 for instance 5a4919f4-824b-4aec-8131-eabe4e8995df on hv-cinder-85697 Oct 15 08:45:38.275807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-24139315-ddf9-40bc-9194-c507d8b19e6d req-e5e6c69f-3bd8-487b-bf38-2336feeaf5c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043357 Oct 15 08:45:38.279379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 102/208] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:38.427615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:38.429279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:38.442203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:38.443322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:38.445103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:38.446763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:38.449554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:38.450226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:38.667766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:38.669226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:38.678014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:38.679339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:38.679997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:38.681181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:38.682029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:38.682681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:38.695227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:38.703626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:38.705075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:38.706234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-19fc78a3-0895-400c-b381-bdd24f235254 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.285799 Oct 15 08:45:38.706781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 107/209] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:38.843513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:38.853215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0eb8f73e-13f6-46a6-9460-6aa88e77fa94 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.190023 Oct 15 08:45:38.854141 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 103/210] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:38 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:39.150989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:39.151598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:39.164932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.166511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.167143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.174344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.174826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.175430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.734210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:39.734821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:39.745063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.746493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.747419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.748677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.748789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:39.750204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.750834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.761914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-040f7689-2ecd-44f2-ad1e-2c7447f10bf8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1322 microversion: 2.1 time: 0.615380 Oct 15 08:45:39.763677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 108/211] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:39 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:39.877363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:39.878600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:39.884832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.885320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.885781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.886473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:39.886927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:39.887381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:39.908239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:39.919106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:39.920852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:39.922287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4452ae49-9b7d-4ce6-90b5-2216063852f3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.191900 Oct 15 08:45:39.923133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 104/212] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:40.022330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:40.031614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aaed680b-3a48-47ad-a848-5b333c3dfebe tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.158127 Oct 15 08:45:40.032508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 109/213] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:39 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:40.296824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28480cd2-5ae8-4292-9c17-be983439b53f", "name": "network-vif-plugged", "status": "completed", "tag": "e3f7288d-02e9-4885-aec1-fcc6483c4bb1"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:40.308981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:40.310002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:40.310431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:40.326138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] Creating event network-vif-plugged:e3f7288d-02e9-4885-aec1-fcc6483c4bb1 for instance 28480cd2-5ae8-4292-9c17-be983439b53f on hv-cinder-85697 Oct 15 08:45:40.331267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-25589875-b566-4b81-9bc7-48346bcc2f5d req-48ba01ca-6c47-4d21-bd33-05e9655b60ae service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038912 Oct 15 08:45:40.331859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 105/214] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:40.790231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:40.791122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:40.800526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:40.801019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:40.801503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:40.802237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:40.802890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:40.803551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:40.951322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:40.952717 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:40.960155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:40.960869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:40.961372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:40.962153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:40.962926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:40.963650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.121719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:41.130504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-32a52b6f-7bed-4516-a65c-a77983ace724 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1516 microversion: 2.1 time: 0.345538 Oct 15 08:45:41.131400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 110/215] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:40 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1516 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:41.137271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:41.138096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:41.147720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.148429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.149070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.150580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.151271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.152069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.264548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:41.276361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:41.278320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:41.283198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-926995e0-f88a-49a0-ade2-d5bde88bd0a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1407 microversion: 2.20 time: 0.338413 Oct 15 08:45:41.299011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 106/216] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:45:41.311744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:41.314447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:41.321892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.322544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.323151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.324005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.324610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.325183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.328744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:41.337467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b33d7d74-b8c4-42ea-9e8e-54c5bf8a6f62 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.204767 Oct 15 08:45:41.338073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 111/217] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:41 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:41.403986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lazy-loading 'flavor' on Instance uuid 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:45:41.506534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:41.550246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-155b3273-1c4c-4605-9c09-ebab8eb0e190 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a/action" status: 200 len: 32 microversion: 2.1 time: 0.249410 Oct 15 08:45:41.550866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 107/218] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 08:45:41 2022] POST /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 08:45:41.560729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:41.561525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:41.570588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.571759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:41.572849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:41.573410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:41.573923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.012818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:42.021031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6bcde376-05a0-45a2-8dfc-e42b4202b218 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.464657 Oct 15 08:45:42.039891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 112/219] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:41 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:42.316961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:42.318532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:42.326153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.326887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.327497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.328185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.328871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.329299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.360286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:42.361225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:42.402878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.403533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.404221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.405963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.408358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.408953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.653255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:42.658406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:42.664601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:42.666463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:42.668131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e9004a08-e66e-488d-adb2-db33c7fb6b23 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1599 microversion: 2.20 time: 0.356304 Oct 15 08:45:42.669921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 108/220] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:45:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1599 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:45:42.670273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-85d08d63-77ae-4741-a96b-063c9710aa06 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1365 microversion: 2.1 time: 0.313665 Oct 15 08:45:42.673336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 113/221] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:42 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:42.701145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:42.701742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:42.712971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.714451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.715116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.716236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:42.716979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:42.718289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:42.855303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9ffb4d02-67ae-4f02-93a6-63997cdb3ae7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160864 Oct 15 08:45:42.857177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 109/222] 10.222.0.30 () {60 vars in 1316 bytes} [Sat Oct 15 08:45:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:45:43.047928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:43.048464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:43.059021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.059549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.059984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:43.065453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.067773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.068254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:43.079579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:43.323799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:43.336331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-21426022-ca74-4b6b-a7ee-57f5978bdaf2 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.290644 Oct 15 08:45:43.351657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 114/223] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:43 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:45:43.698056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:43.698658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:43.709187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.710642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.711394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:43.712250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.712918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.713585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:43.883643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:43.893295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d4622aeb-d225-4c9b-97b1-9051f56e3ed9 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1555 microversion: 2.1 time: 0.200587 Oct 15 08:45:43.893909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 110/224] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:43 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:43.923199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:43.923933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:43.934397 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.935247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.935826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:43.936689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:43.937525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:43.937979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:44.059833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-64641aff-41b0-4630-8278-3a69fbc62361 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144787 Oct 15 08:45:44.060569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 115/225] 10.222.0.30 () {58 vars in 1275 bytes} [Sat Oct 15 08:45:43 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:44.364837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:44.366369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:44.377832 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:44.378337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:44.378943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:44.380320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:44.380990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:44.381428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:44.587728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:44.605533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:44.606048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:44.606484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:44.627999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] Creating event network-changed:3717c011-fe4a-413f-b1ef-15aff3def419 for instance 5a4919f4-824b-4aec-8131-eabe4e8995df on hv-cinder-85697 Oct 15 08:45:44.634454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-ea1f4af4-1b27-4256-9251-e0a0f0f3e3a8 req-b1cf1ffa-de00-48fc-acb1-70337f1f928b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050522 Oct 15 08:45:44.638418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 116/226] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:45:44.655146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:44.663694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6417392a-fba2-46aa-a2bc-b63192e5ad7b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.304686 Oct 15 08:45:44.678254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 111/227] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:44 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:45.687953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:45.689236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:45.702995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:45.707052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:45.707789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:45.708712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:45.709846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:45.710484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:46.052642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28480cd2-5ae8-4292-9c17-be983439b53f", "tag": "e3f7288d-02e9-4885-aec1-fcc6483c4bb1"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:46.081115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:46.082537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:46.084056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:46.108365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:46.125612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d02ce6cc-c6ea-42ea-9be2-4c60e33aadff tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.434477 Oct 15 08:45:46.134417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 117/228] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:45 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:46.142469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] Creating event network-changed:e3f7288d-02e9-4885-aec1-fcc6483c4bb1 for instance 28480cd2-5ae8-4292-9c17-be983439b53f on hv-cinder-85697 Oct 15 08:45:46.161846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-71c7a54b-8fd9-4779-a2a6-54a38fdf2db4 req-d0b95262-1f08-4066-b06e-cec77133d9eb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114816 Oct 15 08:45:46.164062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 112/229] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:45:47.155001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:47.155616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:47.165996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.167625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.168071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:47.168777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.169231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.171031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:47.456991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:47.471582 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-21703402-dc03-4439-bf9c-3ec6efe61d70 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.322052 Oct 15 08:45:47.472163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 118/230] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:47 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:47.622582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:47.624669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:47.632199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.632692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.633699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:47.635016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.636408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.637306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:47.672800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:45:47.788709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eb433c32-495b-459d-9d5c-5dd1998a3d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 204 len: 0 microversion: 2.1 time: 0.172559 Oct 15 08:45:47.790069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 113/231] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:45:47 2022] DELETE /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:45:47.800085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:47.800884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:47.808807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.809443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.810040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:47.810813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:47.811264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:47.815069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:48.008750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:48.018354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-66b80ab2-2bd1-446c-a8fe-55f27c5153ef tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1554 microversion: 2.1 time: 0.223605 Oct 15 08:45:48.019491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 119/232] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:47 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:48.496401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:48.497549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:48.503428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:48.503907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:48.504356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:48.505124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:48.505576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:48.506093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:48.658409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:48.667496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3aa6a79c-4491-4b2e-be96-fe7853fbd534 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.175701 Oct 15 08:45:48.682402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 114/233] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:48 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:49.043083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:49.043907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:49.050827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:49.051314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:49.051733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:49.052617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:49.053064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:49.054159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:49.198088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:49.206929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d1c4bab7-4e59-4f6e-b111-c42a9da58594 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1554 microversion: 2.1 time: 0.167536 Oct 15 08:45:49.207493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 120/234] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:49 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:49.692065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:49.693376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:49.704562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:49.705049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:49.705506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:49.706233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:49.706687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:49.707107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:49.977122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:49.987907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7c871de5-4ddb-4115-8cb7-916de5468e48 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.299930 Oct 15 08:45:49.988574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 115/235] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:49 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:50.230392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:50.231116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:50.243705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:50.245339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:50.246820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:50.248610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:50.249641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:50.250254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:50.561529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:50.571389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f925fd4e-0f53-4139-8881-f8c5ec0b8d9e tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1554 microversion: 2.1 time: 0.344691 Oct 15 08:45:50.585517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 121/236] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:50 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1554 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:50.594035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "425a2fc0-4c28-4213-b32d-21aeb71cbf1f", "name": "network-vif-deleted", "tag": "786783e3-cf68-45e2-b461-ea76864aa665"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:45:50.605152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:50.606244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:50.609409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:50.627060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] Creating event network-vif-deleted:786783e3-cf68-45e2-b461-ea76864aa665 for instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f on hv-cinder-85697 Oct 15 08:45:50.640935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-93933ac1-3661-459c-97be-1e2064148459 req-895c871e-56d8-4d8c-bdaf-f1e83bc9e07d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052200 Oct 15 08:45:50.641530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 116/237] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:45:51.011436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:51.012053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:51.021455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:51.023663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:51.025893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:51.026703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:51.027178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:51.027610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:51.319637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:51.342152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17017b7e-77e7-469f-b029-24850473be34 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.332772 Oct 15 08:45:51.342152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 122/238] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:51 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:51.597486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:51.598457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:51.606794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:51.607538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:51.608778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:51.609733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:51.610438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:51.611343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:51.650068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:51.650563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:51.650993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:51.651619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lazy-loading 'fault' on Instance uuid 425a2fc0-4c28-4213-b32d-21aeb71cbf1f {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:45:51.707500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b1999640b3c41beafefe80d40bf965c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bccc9c2f8b8f4bc3a4dbc121a32d82ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:51.723086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e33148ca-3d64-4735-88f0-8d645559d7f3 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 200 len: 1351 microversion: 2.1 time: 0.131555 Oct 15 08:45:51.723685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 117/239] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:51 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:52.364455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:52.365588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:52.372647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.373292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.380045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.381182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.382564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.383343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.524124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:52.535486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-13d82466-6f99-4149-9ba9-f839aea620ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.174769 Oct 15 08:45:52.536366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 123/240] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:52 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:52.751185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:52.751873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:52.758953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.759656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.760163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.760934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.761398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.761856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.776204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] HTTP exception thrown: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Request method failure captured: Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f HTTP/1.1 Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5Su2Dhji1BCrolQPn9tnzJGUOYeP4IVg_cgj4G7mabsCxlwI9ggLHOnAA15oYuc45IiQh72_0-Lpx8_W8F4cf_wBS5u4KDLYtj7X_o-xke7p55cJj30n40hrdl_WIrHTU54LMbtv02XCqXNnTp7tdZJnTOy_suhWBLAzEGkP9MMQ Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:45:52.780843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bccc9c2f8b8f4bc3a4dbc121a32d82ad", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2b1999640b3c41beafefe80d40bf965c Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '425a2fc0-4c28-4213-b32d-21aeb71cbf1f'} Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:45:52.783355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.784735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.785964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Returning 404 to user: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:45:52.788735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-160fd873-a390-4156-b27f-904a39a6ac93 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 404 len: 111 microversion: 2.1 time: 0.035261 Oct 15 08:45:52.789534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 118/241] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:52 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:45:52.917871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:52.920731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:52.927352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.928019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.928519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.929218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:52.929698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:52.930138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:52.943963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] HTTP exception thrown: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Request method failure captured: Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f/os-volume_attachments HTTP/1.1 Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL5Su2Dhji1BCrolQPn9tnzJGUOYeP4IVg_cgj4G7mabsCxlwI9ggLHOnAA15oYuc45IiQh72_0-Lpx8_W8F4cf_wBS5u4KDLYtj7X_o-xke7p55cJj30n40hrdl_WIrHTU54LMbtv02XCqXNnTp7tdZJnTOy_suhWBLAzEGkP9MMQ Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:45:52.948738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bccc9c2f8b8f4bc3a4dbc121a32d82ad", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 2b1999640b3c41beafefe80d40bf965c Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.950318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'server_id': '425a2fc0-4c28-4213-b32d-21aeb71cbf1f'} Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:45:52.951159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:52.952920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:52.954239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Returning 404 to user: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:45:52.954239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aa36cefd-3824-4d96-b664-8b3d486f1ec2 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040177 Oct 15 08:45:52.954239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 124/242] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:45:52 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:45:53.559556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:53.560252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:53.575414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:53.575899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:53.576337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:53.577029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:53.577482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:53.577999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:53.728953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:53.736890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1f9b45ed-50bb-4895-9e48-e809e66432b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.181548 Oct 15 08:45:53.737456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 119/243] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:53 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:54.198054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:54.198553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:54.205188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.205667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.206118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:54.206799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.207246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.207802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:54.221387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] HTTP exception thrown: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Request method failure captured: Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f HTTP/1.1 Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL5Su2Dhji1BCrolQPn9tnzJGUOYeP4IVg_cgj4G7mabsCxlwI9ggLHOnAA15oYuc45IiQh72_0-Lpx8_W8F4cf_wBS5u4KDLYtj7X_o-xke7p55cJj30n40hrdl_WIrHTU54LMbtv02XCqXNnTp7tdZJnTOy_suhWBLAzEGkP9MMQ Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:45:54.223611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bccc9c2f8b8f4bc3a4dbc121a32d82ad", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 2b1999640b3c41beafefe80d40bf965c Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.225011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '425a2fc0-4c28-4213-b32d-21aeb71cbf1f'} Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:45:54.225822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.227062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.228436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Returning 404 to user: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:45:54.228436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a60b3909-239c-4279-a495-baf15bd872d8 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 404 len: 111 microversion: 2.1 time: 0.032146 Oct 15 08:45:54.228436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 125/244] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:45:54 2022] DELETE /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:45:54.233883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:54.234496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] [instance: 425a2fc0-4c28-4213-b32d-21aeb71cbf1f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:54.241440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.242001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.242439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:54.243126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.243580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.244003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:54.257974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] HTTP exception thrown: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Request method failure captured: Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f HTTP/1.1 Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5Su2Dhji1BCrolQPn9tnzJGUOYeP4IVg_cgj4G7mabsCxlwI9ggLHOnAA15oYuc45IiQh72_0-Lpx8_W8F4cf_wBS5u4KDLYtj7X_o-xke7p55cJj30n40hrdl_WIrHTU54LMbtv02XCqXNnTp7tdZJnTOy_suhWBLAzEGkP9MMQ Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:45:54.259404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bccc9c2f8b8f4bc3a4dbc121a32d82ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bccc9c2f8b8f4bc3a4dbc121a32d82ad", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: bccc9c2f8b8f4bc3a4dbc121a32d82ad Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-DeleteServersTestJSON-481535358 Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 2b1999640b3c41beafefe80d40bf965c Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-DeleteServersTestJSON-481535358-project Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.260792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '425a2fc0-4c28-4213-b32d-21aeb71cbf1f'} Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:45:54.261613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. Oct 15 08:45:54.262816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:45:54.263808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] Returning 404 to user: Instance 425a2fc0-4c28-4213-b32d-21aeb71cbf1f could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:45:54.263808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b0b00d67-eda0-4605-8790-c41676a1aad9 tempest-DeleteServersTestJSON-481535358 tempest-DeleteServersTestJSON-481535358-project] 10.222.0.30 "GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f" status: 404 len: 111 microversion: 2.1 time: 0.030843 Oct 15 08:45:54.263808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 120/245] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:54 2022] GET /compute/v2.1/servers/425a2fc0-4c28-4213-b32d-21aeb71cbf1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:45:54.759152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:54.759767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:54.762048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=91 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:45:54.769071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.769887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.770405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:54.771258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:54.771785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:54.772880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:55.039477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:55.047665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5781288f-2f99-41a4-84a7-2fd8f05ae1d0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.292454 Oct 15 08:45:55.048352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 126/246] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:54 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:56.071373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:56.071985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:56.082081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:56.084474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:56.085095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:56.088388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:56.089059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:56.090254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:56.358335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:56.369215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d60d5987-4c90-469d-b35d-097eb4ec56ca tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.302129 Oct 15 08:45:56.373439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 121/247] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:56 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:57.400173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:57.401498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:57.410821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:57.410821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:57.417128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:57.418093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:57.418744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:57.419247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:57.622105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:57.634662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-458e8b2b-334d-4efc-8a78-92710e94062a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.239462 Oct 15 08:45:57.636339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 127/248] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:57 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:58.658803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:58.661431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:58.669758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:58.670633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:58.671387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:58.672653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:58.673608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:58.674307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:58.828523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:45:58.839365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b873162c-ad58-4d7f-8ec7-41c15883bacf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.184990 Oct 15 08:45:58.840598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 122/249] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:58 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:45:59.869882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:45:59.869882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:45:59.869882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:59.869882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:59.870534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:45:59.871107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:45:59.871503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:45:59.871921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:00.014935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:00.030986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e3c45b9b-df6c-458e-af22-89b937e89acd tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.172731 Oct 15 08:46:00.045733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 128/250] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:45:59 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:01.061820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:01.061820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:01.066257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:01.074761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:01.076325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:01.076778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:01.077516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:01.082404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:01.082973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:01.276706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:01.294187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2fd932c6-e8cf-4db8-825f-161c24595823 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.240658 Oct 15 08:46:01.313915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 123/251] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:01 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:02.325985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:02.326718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:02.332882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:02.333367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:02.333829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:02.334556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:02.335006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:02.335424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:02.476047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:02.485345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-25efcac9-f0ac-48ca-8921-7207e3e8aee0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.163196 Oct 15 08:46:02.485946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 129/252] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:02 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:02.998130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1048028255", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "networks": [{"uuid": "0554bc1a-d5dd-4969-a9cd-1120a3d0db5b"}]}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:03.053336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] validate_networks() for [('0554bc1a-d5dd-4969-a9cd-1120a3d0db5b', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:46:03.438904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:46:03.439329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:46:03.439802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:46:03.440258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:46:03.441080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:46:03.451478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:03.451959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:03.452393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:03.453586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:03.454071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:03.455040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:03.473349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Getting quotas for project 6c350a7b4ae944c188fc8af5a91438f3. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:46:03.477475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Getting quotas for user d716aed1f7684cda9b82ba0d5c3d24d4 and project 6c350a7b4ae944c188fc8af5a91438f3. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:46:03.488628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:46:03.491010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:46:03.510910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:03.516004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:03.530015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:03.531697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:03.532246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:03.533984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:03.535726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:03.536712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:03.565195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-65f39f43-6d1f-4ef6-a063-80da057705c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570975 Oct 15 08:46:03.566189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 124/253] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:46:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:46:03.577258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fbff263d-be32-4ec7-a768-ce7904aac4a4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:03.578452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fbff263d-be32-4ec7-a768-ce7904aac4a4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:03.682605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fbff263d-be32-4ec7-a768-ce7904aac4a4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:03.690002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fbff263d-be32-4ec7-a768-ce7904aac4a4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1219 microversion: 2.1 time: 0.116331 Oct 15 08:46:03.690576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 125/254] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1219 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:03.784140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:03.793233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-33113f5b-8d55-4c19-b5a6-00bbbbedde24 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.288095 Oct 15 08:46:03.794320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 130/255] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:03 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:04.719156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:04.726762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:04.748607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:04.749888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:04.750722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:04.752131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:04.753367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:04.754055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:04.796579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:04.821414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:04.822604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:04.831479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:04.832317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:04.832998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:04.834159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:04.835435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:04.836074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:04.866837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:04.875914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-79185fc0-e29b-4beb-855e-51c938b0d12f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1271 microversion: 2.1 time: 0.160558 Oct 15 08:46:04.876807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 126/256] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:05.004611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:05.013453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f2c44c01-1f59-4dca-9adc-2c67817ce87c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.199236 Oct 15 08:46:05.014001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 131/257] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:04 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:05.903890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:05.904634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:05.914927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:05.915760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:05.916653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:05.918144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:05.918823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:05.919447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:06.007734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:06.016421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-15b451e4-ab3f-478f-aff5-8e3c05022409 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1271 microversion: 2.1 time: 0.117651 Oct 15 08:46:06.017135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 127/258] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:06.036373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:06.037645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:06.044114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:06.044807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:06.045392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:06.046400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:06.047852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:06.048815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:06.219246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:06.231397 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c13d5f73-6fa0-4a6e-a100-a07c9605222c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.198764 Oct 15 08:46:06.231987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 132/259] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:06 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:07.044644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:07.045333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:07.051631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:07.052119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:07.052577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:07.053336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:07.053818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:07.054243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:07.119044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:07.127260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-26cecaa7-11ac-48c0-80ad-63b6bd321323 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1271 microversion: 2.1 time: 0.089519 Oct 15 08:46:07.137709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 128/260] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:07 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:07.255174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:07.257133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:07.263931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:07.264713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:07.265206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:07.266150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:07.266764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:07.267176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:07.272665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:07.413147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:07.421027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5aa07a12-3e6d-4e9e-be2e-1651cb7d48ed tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.170135 Oct 15 08:46:07.421910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 133/261] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:07 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:08.153148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:08.153862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:08.170276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:08.170810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:08.171268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:08.177561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:08.182724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:08.183501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:08.326589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:08.337375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-987f6e5d-3f5f-48cc-8377-3df4913cf035 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1277 microversion: 2.1 time: 0.187902 Oct 15 08:46:08.340041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 129/262] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:08 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:08.445058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:08.446346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:08.455450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:08.458026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:08.458676 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:08.460093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:08.462857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:08.463465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:08.792743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:08.807667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b7f7e2ce-ae0c-4417-b4a4-f4a51ca6b049 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.365235 Oct 15 08:46:08.808958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 134/263] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:08 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:09.362248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:09.363696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:09.372807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:09.373530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:09.374197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:09.375063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:09.375730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:09.376313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:09.651671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:09.660195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c57f0824-b1f9-4a76-8819-0cf2f01bb3c9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.301934 Oct 15 08:46:09.679376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 130/264] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:09.832508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:09.833816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:09.846683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:09.847449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:09.848039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:09.848886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:09.849663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:09.854049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:10.016711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9eb9c-612a-4b42-8103-e2bb037d1f39", "tag": "59c5c456-2eaf-42bc-8aef-e4159b0ecdb2"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:10.043268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:10.043776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:10.044219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:10.076263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] Creating event network-changed:59c5c456-2eaf-42bc-8aef-e4159b0ecdb2 for instance 83c9eb9c-612a-4b42-8103-e2bb037d1f39 on hv-cinder-85697 Oct 15 08:46:10.087016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-df877160-333e-4509-a766-7ed90663430e req-992f3165-cdc5-42b3-8ac1-4adde426e939 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075756 Oct 15 08:46:10.089078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 131/265] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:46:10.221520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:10.241426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5b26ab21-5211-4897-943a-753c5daafc69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.408659 Oct 15 08:46:10.241426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 135/266] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:09 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:10.686975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:10.687704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:10.700700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:10.701186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:10.701804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:10.702502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:10.703159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:10.709103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:10.908166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:10.918490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-83ca49a0-15ed-4e38-9057-8c15619f5d51 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.235587 Oct 15 08:46:10.935201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 132/267] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:11.263112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:11.263707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:11.269869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:11.274570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:11.275207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:11.275952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:11.276406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:11.280914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:11.538773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:11.551184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-78754e7f-6608-48cf-a2cf-ccc9e32bc0c8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.290065 Oct 15 08:46:11.551832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 136/268] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:11 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:11.946450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:11.947732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:11.954384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:11.955974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:11.956633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:11.957580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:11.958322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:11.958955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:12.234342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:12.243459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7f7d2b6e-5254-4e26-89fb-289d6f4d90a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.304585 Oct 15 08:46:12.259471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 133/269] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:12.578394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:12.580003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:12.587597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:12.588647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:12.589319 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:12.590614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:12.592744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:12.593788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:12.984263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:12.993621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94c9a5ef-87ba-4440-87f8-e5dd908f6ad4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.422988 Oct 15 08:46:12.994234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 137/270] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:12 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:13.273032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:13.278018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:13.292173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:13.292730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:13.293437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:13.294215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:13.295481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:13.296060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:13.463354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:13.686448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=8 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:13.982629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:13.990861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f8351f2e-814c-4387-bf98-4eda2cd55a15 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.725137 Oct 15 08:46:13.993743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 134/271] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:14.016440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:14.017590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:14.028386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:14.029438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:14.030102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:14.030978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:14.031590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:14.032172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:14.244861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:14.255745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-10a6a6fa-20eb-4f80-8ced-edf0858448d5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.242877 Oct 15 08:46:14.265712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 138/272] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:14 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:15.017511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:15.018213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:15.026572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:15.028131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:15.028889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:15.029705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:15.030272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:15.030826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:15.252283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:15.263908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e34867de-77d6-4351-b5ba-54ca88a04fca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.250951 Oct 15 08:46:15.265260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 135/273] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:15.281575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:15.282334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:15.290958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:15.291783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:15.292461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:15.293571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:15.294477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:15.297369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:15.571451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:15.583817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e60439c3-f016-41e3-97cb-edae7b5cfc15 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.306795 Oct 15 08:46:15.585763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 139/274] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:15 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:15.809094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9eb9c-612a-4b42-8103-e2bb037d1f39", "name": "network-vif-plugged", "status": "completed", "tag": "59c5c456-2eaf-42bc-8aef-e4159b0ecdb2"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:15.819629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:15.820326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:15.820909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:15.833052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] Creating event network-vif-plugged:59c5c456-2eaf-42bc-8aef-e4159b0ecdb2 for instance 83c9eb9c-612a-4b42-8103-e2bb037d1f39 on hv-cinder-85697 Oct 15 08:46:15.838358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-f29fd70e-b7ee-4f85-9822-243faf1002a4 req-c2dc6efe-9409-4bed-b04b-f0f498c7947a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Oct 15 08:46:15.839259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 136/275] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:16.290520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:16.291169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:16.297851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:16.298650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:16.299089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:16.299837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:16.300293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:16.302689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:16.494781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:16.503594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-95a0e2e7-128d-403c-ac2b-a7259ce1c9dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.219559 Oct 15 08:46:16.520076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 140/276] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:16.613010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:16.614679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:16.631903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:16.632417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:16.632862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:16.633578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:16.634063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:16.634680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:16.823568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:16.833319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-18a986c0-725c-42c9-b75d-f7885bbfc648 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.225531 Oct 15 08:46:16.855242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 137/277] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:16 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:17.528141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:17.528740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:17.543167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:17.543771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:17.544210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:17.545187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:17.545877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:17.546592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:17.712683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:17.727600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e3d84f1b-84fd-4fa9-b067-dfb80ad07a65 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1319 microversion: 2.1 time: 0.203546 Oct 15 08:46:17.733448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 141/278] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:17.864175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:17.865482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:17.872730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:17.873440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:17.874071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:17.875152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:17.875755 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:17.876340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:18.063299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:18.077032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aa763381-07ef-4aa8-b220-1c6a81c4fda0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.217289 Oct 15 08:46:18.077618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 138/279] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:17 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:18.751588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:18.753142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:18.766253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:18.767259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:18.767930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:18.769120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:18.769901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:18.770883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:19.018938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:19.028335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-02538a40-fea7-4194-a04c-d57fb34d2792 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1508 microversion: 2.1 time: 0.281508 Oct 15 08:46:19.029085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 142/280] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1508 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:19.101941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:19.102860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:19.117336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:19.118665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:19.120933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:19.124032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:19.124924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:19.128143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:19.340251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:19.350407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b623217c-c183-4c82-960d-51d6b70b0283 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.252521 Oct 15 08:46:19.351378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 139/281] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:19 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:20.374847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:20.376194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:20.408681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:20.409203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:20.419164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:20.419954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:20.420518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:20.420892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:20.623128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:20.636838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1e3fd3ad-70d0-4f10-a629-30eda69b02f8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.265704 Oct 15 08:46:20.664081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 143/282] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:20 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:21.666484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:21.667950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:21.674802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:21.675270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:21.675699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:21.676747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:21.677399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:21.678729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:21.847639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:21.858380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-52d53761-51da-4047-96ae-b4030bc76839 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.195683 Oct 15 08:46:21.871234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 140/283] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:21 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:22.883561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:22.884928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:22.890837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:22.891536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:22.892117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:22.893145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:22.893777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:22.894357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:23.061734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:23.071341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-91eec032-891b-4ad1-886a-b42d103364b0 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.194388 Oct 15 08:46:23.081905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 144/284] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:22 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:24.095817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:24.096711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:24.107230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:24.107230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:24.108135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:24.108877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:24.109373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:24.109794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:24.444864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:24.452389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-51d79128-df83-48fb-8792-b3fca9050bda tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.360485 Oct 15 08:46:24.453307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 141/285] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:24 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:24.942110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2368f267-497d-4624-92db-5ecce5e35104 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Action: 'create', calling method: .version_select at 0x7f575af47f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1501984454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWC360a57faI5OLYU1JwH+VAsIDIcBNivPvOcsC+Qo7Iuc/ZZpm0YQEY1TNIOIUA6PaLjeejLSx7OslyQDmwTJs4WRp4GZrLb99Swt2H4mNOMrhNYc1O0kcj1U+a+b4KQ=="}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:24.949384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=38 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:24.965767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-2368f267-497d-4624-92db-5ecce5e35104 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Getting quotas for project 678aa241e39f4bea9fa9e73e82afbd0b. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:46:24.971126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-2368f267-497d-4624-92db-5ecce5e35104 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Getting quotas for user f05cbab4640048589b9509fd9e8f655a and project 678aa241e39f4bea9fa9e73e82afbd0b. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:46:25.000372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2368f267-497d-4624-92db-5ecce5e35104 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061867 Oct 15 08:46:25.001743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 145/286] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 08:46:24 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:25.110341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1190690084", "imageRef": "a4668e38-7c99-44a4-8958-88475a270f53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1501984454", "networks": [{"uuid": "e3da8633-cfbd-4bb2-8fa9-d53bc773831e"}]}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:25.167572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] validate_networks() for [('e3da8633-cfbd-4bb2-8fa9-d53bc773831e', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:46:25.476698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:25.477309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:25.483762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:25.484772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:25.485225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:25.486086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:25.486543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:25.486964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:25.603524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:46:25.604272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:46:25.604840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:46:25.605361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:46:25.606284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:46:25.616259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:25.616742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:25.617489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:25.618316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:25.618827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:25.619704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:25.640361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Getting quotas for project 678aa241e39f4bea9fa9e73e82afbd0b. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:46:25.644474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Getting quotas for user f05cbab4640048589b9509fd9e8f655a and project 678aa241e39f4bea9fa9e73e82afbd0b. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:46:25.654238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:25.656883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:46:25.659316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a4668e38-7c99-44a4-8958-88475a270f53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:46:25.664275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-031f15f5-9e87-4ec3-9f6e-d3375454506f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.192315 Oct 15 08:46:25.665162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 146/287] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:25 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:25.710433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0ce030d6-402a-41b9-b81d-d62a5fa18606 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603889 Oct 15 08:46:25.717338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 142/288] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:46:25.722996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6b5653e0-7254-42a7-b585-df1f89fbd270 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:25.723589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6b5653e0-7254-42a7-b585-df1f89fbd270 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:25.781461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6b5653e0-7254-42a7-b585-df1f89fbd270 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:25.789230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6b5653e0-7254-42a7-b585-df1f89fbd270 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1259 microversion: 2.1 time: 0.070823 Oct 15 08:46:25.790107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 147/289] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:25 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:26.688069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:26.688603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:26.695673 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:26.696150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:26.696573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:26.697244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:26.697708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:26.698127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:26.812630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:26.813256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:26.820123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:26.820613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:26.821799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:26.822507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:26.822962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:26.823591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:26.832970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:26.842719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f36f32e6-2f8b-45d8-a9ef-a856923778fb tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1522 microversion: 2.1 time: 0.158894 Oct 15 08:46:26.843396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 143/290] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:26 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:26.888152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:26.895950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7e15ac05-c6b3-4ee0-986b-207ea9904ba8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1311 microversion: 2.1 time: 0.087463 Oct 15 08:46:26.896497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 148/291] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:26 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:27.869355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:27.870049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:27.876828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:27.877616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:27.878225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:27.879023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:27.879549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:27.880093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:27.919420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:27.920022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:27.926444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:27.926929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:27.927359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:27.928065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:27.928513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:27.928927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:28.002075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:28.011711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e338a2eb-c44d-49d3-8748-36ea3f77090a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1319 microversion: 2.1 time: 0.095949 Oct 15 08:46:28.012707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 149/292] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:27 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:28.045045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:28.052715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e549a635-bb3f-4a09-bfa8-6d1dadf9bf2b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1502 microversion: 2.1 time: 0.189307 Oct 15 08:46:28.053294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 144/293] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:27 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1502 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:28.074584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:28.075190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:28.081028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:28.081500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:28.081984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:28.082655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:28.083099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:28.083536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:28.216376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:28.224316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe276a43-ae14-4794-92db-73a77580e1cf tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1515 microversion: 2.1 time: 0.153582 Oct 15 08:46:28.224868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 150/294] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:28 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:29.035714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:29.036907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:29.043917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.044396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.044822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:29.045887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.046488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.047639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:29.052023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:29.128915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:29.159812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ba5f8d56-b974-4de1-bfed-3b2457c79cb0 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1317 microversion: 2.1 time: 0.127566 Oct 15 08:46:29.189002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 145/295] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:29 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1317 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:29.710692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:29.714130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:29.720276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.720956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.721610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:29.722578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.723196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.723770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:29.748505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lazy-loading 'flavor' on Instance uuid 60a56b6e-d8d1-4f32-b72f-d1d4135779ff {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:46:29.779021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:29.886839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-98d52068-7a60-409a-9abe-e840f6448383 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/action" status: 200 len: 32 microversion: 2.1 time: 0.179570 Oct 15 08:46:29.891679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 151/296] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 08:46:29 2022] POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/action => generated 32 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 08:46:29.896925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:29.897526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:29.903973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.924246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.926608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:29.927359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:29.927831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:29.928254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:30.104692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:30.113656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f7af4776-e327-4960-a6af-1f846c5de614 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.220699 Oct 15 08:46:30.114451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 146/297] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:29 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:30.198052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:30.200548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:30.207698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:30.208311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:30.209063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:30.209805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:30.210402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:30.211569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:30.381871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:30.391170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-29979e8c-7d59-47b0-83f7-7842847f3893 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.198203 Oct 15 08:46:30.392034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 152/298] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:30 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:31.136716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:31.137317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:31.139749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:31.147263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:31.147754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:31.148190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:31.148895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:31.149348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:31.149801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:31.290199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:31.297814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ff664edc-0df9-4695-aafa-e49c74cab7a7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.165112 Oct 15 08:46:31.298366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 147/299] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:31 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:31.423426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:31.424047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:31.430382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:31.430864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:31.431297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:31.431982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:31.432432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:31.432856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:31.568589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:31.577602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7ab16c7d-654f-43ad-93b1-a46a9636834d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.158122 Oct 15 08:46:31.578227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 153/300] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:31 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:32.322256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:32.322871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:32.328876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:32.329351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:32.329821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:32.330503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:32.330949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:32.331370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:32.491876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:32.503247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fc444e33-64f2-49c4-957c-52a09f788573 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.184795 Oct 15 08:46:32.503830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 148/301] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:32 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:32.601281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:32.603240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:32.611549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:32.612260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:32.613727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:32.614821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:32.615492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:32.616104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:32.784325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:32.792675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5befcb65-e921-419f-84bb-8f37d8091623 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.196174 Oct 15 08:46:32.805974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 154/302] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:32 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:33.440904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:33.442301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:33.452751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.453242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.457071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.457838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.458325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.458757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.505943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7c754115-aac0-4759-823b-306181323e61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/ips" status: 200 len: 146 microversion: 2.1 time: 0.070348 Oct 15 08:46:33.506522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 149/303] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:46:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/ips => generated 146 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:33.529615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:33.530659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:33.537397 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.538010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.538853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.541470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.542168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.542652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.726173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:33.735353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-36074ce2-45ae-43fd-9248-f0b0d9a38559 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.210483 Oct 15 08:46:33.736993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 155/304] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:33 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:33.816291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:33.817043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:33.823728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.824447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.825042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.825932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:33.826532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:33.827259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:33.995128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:34.003577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e93aa62d-aa7e-4d60-a544-9fbde86d0ff3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.191055 Oct 15 08:46:34.004139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 150/305] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:33 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:34.760531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:34.761781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:34.768223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:34.768698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:34.769127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:34.769866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:34.770313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:34.770726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:34.925127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:34.934229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8623f059-a533-488f-811a-1a0e67a26083 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.178493 Oct 15 08:46:34.949448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 156/306] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:34 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:35.029249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:35.029882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:35.036947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:35.037652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:35.038258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:35.039670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:35.040279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:35.040866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:35.213698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:35.223018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-96141732-0cde-4cba-a532-ee46bd203cd5 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.197643 Oct 15 08:46:35.223846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 151/307] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:35 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:35.957125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:35.957947 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:35.960787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:35.970828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:35.971326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:35.971999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:35.972883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:35.973362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:35.973836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:36.151766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:36.161024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f9252e25-4d29-480b-b6b3-2d30b199c7c5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.207855 Oct 15 08:46:36.161733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 157/308] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:35 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:36.246220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:36.246896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:36.249057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:36.249967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=6 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:36.256335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:36.256825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:36.257298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:36.258550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:36.259003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:36.259425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:36.416581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:36.424529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-38fc238b-4190-479e-8ceb-7ef2d8d2490f tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.182542 Oct 15 08:46:36.425092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 152/309] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:36 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:36.907826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cc4d512-e380-4e9b-8c35-477c7d66eb5b"}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:36.910498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:36.917225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:36.917796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:36.918256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:36.918964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:36.919409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:36.919865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:37.186076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:37.186687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:37.192915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:37.193399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:37.193905 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:37.194681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:37.195960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:37.196457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:37.339469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:37.348111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-76001834-4b46-419b-9d3f-2c57f62ae34c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.165806 Oct 15 08:46:37.348679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 153/310] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:37 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:37.448080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:37.448694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:37.454780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:37.455267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:37.455702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:37.456395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:37.456997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:37.457416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:37.591715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:37.599769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9b7fe1e6-997a-4ef1-89c9-d1b81f15cd9a tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.156080 Oct 15 08:46:37.612439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 154/311] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:37 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:38.372068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:38.372744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:38.379580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.380062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.380487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:38.381168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.381638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.382104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:38.532985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:38.541356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-69247bbf-7bae-4dd5-bb4e-52aa5e388d9a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.173573 Oct 15 08:46:38.542028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 155/312] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:38 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:38.624161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:38.625020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:38.631985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.632464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.632892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:38.633803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.634761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.635182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:38.784395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:38.792168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c8bbdf75-7918-4857-b430-bfd6b904faf8 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.172132 Oct 15 08:46:38.792751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 156/313] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:38 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:38.953032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44736cc1-2043-4bf9-8c76-df1be9dd362d", "device": "/dev/sdb"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:38.956482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:38.963482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.963966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.964402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:38.965099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:38.965544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:38.965990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:41.590513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fdbeae78-5454-4bd2-a1c7-6382c5848ddb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "POST /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.641551 Oct 15 08:46:41.596984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 157/314] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 08:46:38 2022] POST /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39/os-volume_attachments => generated 194 bytes in 2643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:41.597906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3aeb2ac7-fc00-4c47-95ab-e31bb9f47db1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.693855 Oct 15 08:46:41.598951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 158/315] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 08:46:36 2022] POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 194 bytes in 4696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:41.618125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:41.619537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:41.635994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:41.636853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:41.643669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:41.644166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:41.644605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:41.645319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:41.645806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:41.646234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:41.647270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:41.647953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:41.648618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:41.650174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:41.651122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:41.651737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:42.222330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:42.231810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:42.233221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a70f5fa3-c4bc-49dd-bca2-5d50a898e875 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.632888 Oct 15 08:46:42.233924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 159/316] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:41 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:42.239139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:42.239632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:42.249395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:42.249926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:42.250358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:42.251244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:42.251386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-edacf9a3-ad89-4901-a62c-9df01bda5565 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.659007 Oct 15 08:46:42.251699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:42.252118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:42.252242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 158/317] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:41 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:42.277583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9e20f619-57d5-4b1b-b043-0b9743f1d028 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/ips" status: 200 len: 152 microversion: 2.20 time: 0.042595 Oct 15 08:46:42.278181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 160/318] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Oct 15 08:46:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/ips => generated 152 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:46:42.457694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:42.458541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:42.466731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:42.467706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:42.468375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:42.469395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:42.470144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:42.471241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:42.502831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3501312d-904f-45c8-a3ee-4a520e30dcf1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/ips" status: 200 len: 150 microversion: 2.1 time: 0.049258 Oct 15 08:46:42.516451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 159/319] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:46:42 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:43.246856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d610f4-f0b3-42b0-a0da-49f639edb8a4", "tag": "8a417772-ea4c-4158-816d-dad8275496c9"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:43.257074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:43.258285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:43.260461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:43.261163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:43.261571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:43.265488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:43.266224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:43.266872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:43.267759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:43.268217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:43.268647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:43.276477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] Creating event network-changed:8a417772-ea4c-4158-816d-dad8275496c9 for instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 on hv-cinder-85697 Oct 15 08:46:43.281285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-e7d8efb0-ea38-4d45-b626-2e992118bbc5 req-6e36ab34-6892-4eba-b67d-dc984ae025d1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038134 Oct 15 08:46:43.281945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 161/320] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:46:43.287141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:43.288024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:43.294846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:43.295524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:43.296477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:43.297445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:43.297927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:43.298351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:43.656012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:43.662474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:43.664295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-574bca6e-c80b-4c8e-9b71-d582e1d51de7 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.411818 Oct 15 08:46:43.672501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 160/321] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:43 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:43.673311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7a71dee2-abbf-4d8e-99f0-14fc890ce1fe tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.388145 Oct 15 08:46:43.673311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 162/322] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:43 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:44.008963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb27624c-e0c2-43b7-873e-24dd3c51544f"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:44.011545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:44.024049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.024539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.025128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.026610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.027107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.027494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.031717 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:44.314661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4d8e414-2f05-4fee-a35d-a5b64b5e424f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309807 Oct 15 08:46:44.315319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 161/323] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 08:46:44 2022] POST /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:46:44.458894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:44.459448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:44.466556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.467036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.467468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.468150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.468604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.469024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.492646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lazy-loading 'flavor' on Instance uuid 5a4919f4-824b-4aec-8131-eabe4e8995df {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:46:44.689265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:44.690253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:44.696830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.697312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.697840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.698559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.698994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.699414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.845865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:44.854968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1d7c8ba9-900e-4503-9b4c-0e858c145dee tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.170558 Oct 15 08:46:44.856338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 162/324] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:44 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:44.861540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:44.862185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:44.865118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86ae152e-7584-49ea-b585-d47b12d2f056 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/action" status: 202 len: 0 microversion: 2.20 time: 0.409428 Oct 15 08:46:44.865799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 163/325] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Oct 15 08:46:44 2022] POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:46:44.869923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.870445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.870878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.871577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.872032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.872457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.878336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:44.879036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:44.886634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.887471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.888155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.889046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:44.889821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:44.890299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:44.914378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:45.076870 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:45.080287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:45.084747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-430aa036-182a-410c-9165-f0a2239bb703 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.227272 Oct 15 08:46:45.085431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 163/326] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:44 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:45.094131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:45.095562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:45.096720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-477af2b0-f8f2-4c16-9011-56694c5c6a75 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.223257 Oct 15 08:46:45.097251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 164/327] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:45.880054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:45.880615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:45.896370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:45.896941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:45.897379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:45.898130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:45.898589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:45.899013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:46.081824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:46.093649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-598ecde5-4035-4c3e-ba50-465dc7e6e263 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.217449 Oct 15 08:46:46.095101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 164/328] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:45 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:46.111744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:46.112701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:46.121164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:46.121651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:46.122106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:46.122789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:46.123014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:46.123238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:46.123654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:46.123974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:46.130667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:46.131232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:46.131754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:46.132556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:46.133088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:46.133530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:46.386677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:46.394981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:46.396539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:46.397829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-790ae15b-df23-4437-80d8-441c684bcc84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.279619 Oct 15 08:46:46.398648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 165/329] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:46:46.416665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:46.424544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e4c54af6-713e-426d-aea2-acb77009a1b5 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.317158 Oct 15 08:46:46.425410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 165/330] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:46 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:47.118286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:47.118924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:47.125293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.125805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.126244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.126926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.127377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.127800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.260335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:47.268042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c4a2d615-a753-4eee-a700-b78bb39b3ae9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.153613 Oct 15 08:46:47.268597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 166/331] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:47 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:47.424326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:47.424941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:47.432044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.433113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.433562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.434429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.434966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.435408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.447289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:47.448041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:47.454023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.454496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.454918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.455593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.456035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.456451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.639220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:47.642312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:47.647583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:47.649019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:47.651056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ef76f87a-1c64-4dab-85d0-c5d602687173 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.230345 Oct 15 08:46:47.651610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 166/332] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:47.651715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-800d5140-461f-4c73-815e-614cc42c795a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.208492 Oct 15 08:46:47.653326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 167/333] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:47 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:47.810456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d610f4-f0b3-42b0-a0da-49f639edb8a4", "name": "network-vif-plugged", "status": "completed", "tag": "8a417772-ea4c-4158-816d-dad8275496c9"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:46:47.820039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:47.820537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:47.820944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:47.833112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] Creating event network-vif-plugged:8a417772-ea4c-4158-816d-dad8275496c9 for instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 on hv-cinder-85697 Oct 15 08:46:47.838212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-dac22c99-0174-4a0e-99e4-ce4419c7fa59 req-4fa933c9-5187-463f-91df-e195a1fcea91 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Oct 15 08:46:47.838808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 167/334] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:48.292907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:48.293498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:48.302997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.303454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.304080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.304893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.305241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.305702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.503813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:48.511542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4ee204b7-cc4c-4323-b146-89d4bb7d0408 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.223409 Oct 15 08:46:48.512112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 168/335] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:48 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:48.676519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:48.677250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:48.677380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:48.678201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:48.683703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.684176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.684407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.684665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.684884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.685309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.685407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.685856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.686082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:48.686297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.686532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:48.687006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:48.883387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:48.890784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:48.892036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:48.893461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:48.894625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ab6f6389-7098-499e-a813-268d5752b02d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.222298 Oct 15 08:46:48.895176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 169/336] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:48.898513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f4b0d1d1-0ea6-4ecb-a76f-adb75f5d4d4d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.225944 Oct 15 08:46:48.899061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 168/337] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:48 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:49.534308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:49.534942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:49.541481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.541999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.542426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:49.543095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.543541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.543954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:49.673293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:49.681638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a6d64dfe-6f52-4ba3-8a43-76b4c55e68c4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.150495 Oct 15 08:46:49.682268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 170/338] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:49 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:49.921472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:49.921637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:49.922157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:49.922321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:49.928375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.928515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.928851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.928968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.929277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:49.929388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:49.929983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.930087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:49.930537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.930629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:49.931592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:49.931700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:50.119850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:50.122696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:50.127664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-697c1ddf-5bea-4122-a21f-ce3520aa0840 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.209943 Oct 15 08:46:50.128309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 171/339] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:49 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:50.130688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:50.132117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:50.133271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-257dab8c-21cf-44a6-9cb0-01b59e2f315a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.215595 Oct 15 08:46:50.134509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 169/340] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:50.704205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:50.704806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:50.711115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:50.711616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:50.712038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:50.712718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:50.713166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:50.713584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:50.840665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:50.848201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-17104b2e-664d-4048-a9c5-1038f1a4c87c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.147830 Oct 15 08:46:50.848792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 172/341] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:50 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:51.152191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:51.152824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:51.158904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:51.159369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.159511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:51.159847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.160277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:51.160966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.161417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.161869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:51.166024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.166505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.166939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:51.167624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.168079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.168501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:51.355898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:51.359506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:51.363520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4d7853b1-bd30-4819-928d-10a5fd687f0c tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.215981 Oct 15 08:46:51.364084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 170/342] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:51 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:51.367541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:51.369093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:51.370266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-303a0538-0e4c-4138-bb54-52198e1716ce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.215219 Oct 15 08:46:51.370881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 173/343] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:46:51.871665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:51.872305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:51.878213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.878688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.879114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:51.879782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:51.880226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:51.880640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:52.004683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:52.013264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-63f493a8-e19e-4c47-819e-be72dcfab5f3 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.145482 Oct 15 08:46:52.013860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 171/344] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:51 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:52.387568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:52.388821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:52.395619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:52.396112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:52.396536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:52.397232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:52.397698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:52.398231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:52.398690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:52.398873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:52.405948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:52.406431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:52.406858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:52.407540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:52.408056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:52.408611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:52.586006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:52.590119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:52.593660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9e43f7f7-2b67-4d33-bbb6-2aec1260b906 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.211160 Oct 15 08:46:52.594243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 174/345] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:52 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:52.598228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:52.599696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:52.600848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3fb7079b-4294-475b-9b31-6d914a9cc0ef tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.206573 Oct 15 08:46:52.601507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 172/346] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:46:53.036373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:53.036974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:53.043412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.043883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.044306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.044985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.045431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.045876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.176419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:53.184300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-90bb2c65-a14a-4634-aecc-1ecbead4af59 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1359 microversion: 2.1 time: 0.151685 Oct 15 08:46:53.185080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 175/347] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:53 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:53.616369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:53.617060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:53.624674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.625155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.625587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.626300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.626751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.627168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.629101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:53.629833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:53.637710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.638592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.639039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.639730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:53.640757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:53.641956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:53.674338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:53.845813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:53.849734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:53.853903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe95ee7b-7c34-4f58-82ab-dedcbdf9726a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.241485 Oct 15 08:46:53.854572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 173/348] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:53 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:53.858290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:53.859734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:53.860886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1c00dc3b-5a1d-4300-985d-c137cb6e4ff7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.237840 Oct 15 08:46:53.861412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 176/349] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:46:54.205857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.206468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:54.212355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.212835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.213269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.213969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.214424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.214844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.340591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:54.348182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17692ce3-dad7-4f9a-aec3-fbe7967e657c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1550 microversion: 2.1 time: 0.146168 Oct 15 08:46:54.348743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 174/350] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1550 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:54.371784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.372385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:54.378311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.378778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.379205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.379879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.380352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.380772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.507071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:54.515246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f47262b-d2cb-4f3c-8d74-da1d36ac7f6d tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1550 microversion: 2.1 time: 0.147890 Oct 15 08:46:54.515805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 177/351] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:54.537329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.542194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:54.542959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Searching by: {'deleted': False, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b'} {{(pid=125329) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 15 08:46:54.549498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.550005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.550436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.551152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.551604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.552022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.642690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.multi_cell_list [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125329) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 15 08:46:54.740301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0f0f70bb-396d-473c-9186-2010c7d10e46 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206638 Oct 15 08:46:54.740873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 175/352] 10.222.0.30 () {58 vars in 1125 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:46:54.752644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.753247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:54.760252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.760729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.761155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.761865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.762312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.762725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.877251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.877911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:54.883890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.884375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.884793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:54.884920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.885488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.885970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.886396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.892520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9a7462bf-2205-4f64-872f-b516e8f80a85 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1550 microversion: 2.1 time: 0.143609 Oct 15 08:46:54.893136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 178/353] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1550 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:54.897522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:54.898168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:54.904419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.904887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.905311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:54.906007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:54.906455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:54.906870 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:55.101411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:55.104912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:55.111014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a0201b65-2e8b-4ac2-a592-70c007103e89 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.237440 Oct 15 08:46:55.111678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 176/354] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:46:55.114544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:55.116144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:55.117363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4dad6fe9-0d58-4bc4-820c-8119ad2b0ffa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.223382 Oct 15 08:46:55.118063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 179/355] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:56.135487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:56.136274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:56.138769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:46:56.142892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:56.143527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:56.144058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:56.144546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:56.144983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:56.145699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:56.146160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:56.146587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:56.151301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:56.151780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:56.152209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:56.152900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:56.153351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:56.153809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:56.341472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:56.345393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:56.349432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a81d5900-9d87-426d-968d-d6984fe6a0b9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.217915 Oct 15 08:46:56.350038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 177/356] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:56 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:56.354931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:56.356359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:56.357561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e6cf5186-5c1d-43ce-a28b-026351a77c78 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.218794 Oct 15 08:46:56.358142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 180/357] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:56 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:46:57.372881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:57.373499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:57.380125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:57.380603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:57.381028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:57.381739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:57.382194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:57.382611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:57.383715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:57.384322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:57.391015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:57.391499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:57.391936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:57.392628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:57.393224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:57.393658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:57.825335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:57.827860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:57.833165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8c5a1cdd-dd98-415d-9310-950c561f9a87 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.464616 Oct 15 08:46:57.834061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 178/358] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:57 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:57.836294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:57.837839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:57.839050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c6209bb7-7300-4e96-ac35-9e204f2ee48d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.459440 Oct 15 08:46:57.839821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 181/359] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:46:58.856245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:58.856862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:58.863373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:58.863854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:58.864290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:58.864751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:46:58.865131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:58.865384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:46:58.865479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:58.865855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:58.872330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:58.872803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:58.873227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:58.873985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:46:58.874430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:46:58.874871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:46:59.057484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:59.060354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:59.065260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c997a76d-a7d3-4794-aceb-8379d22bacf4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.213510 Oct 15 08:46:59.065908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 179/360] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:46:58 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:46:59.068463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:59.069918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:46:59.071058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6c616ccc-2ca9-4ba1-8001-0c183fd2b913 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210123 Oct 15 08:46:59.072207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 182/361] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:46:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:00.088305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:00.088916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:00.095747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:00.096102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:00.096498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:00.096652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:00.096754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:00.097338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:00.097825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:00.098253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:00.103316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:00.103849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:00.104375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:00.105067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:00.105549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:00.106012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:00.302760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:00.310214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:00.311275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c3d8fd87-6edf-44d4-a192-b43a648bcdd3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.226808 Oct 15 08:47:00.311839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 180/362] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:00 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:00.320133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:00.321578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:00.322801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a9e10fc5-7a8b-41ac-9ff4-feb8c2abcbcd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.230537 Oct 15 08:47:00.323360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 183/363] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:01.334906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:01.335526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:01.343670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:01.343670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:01.343670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:01.344072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:01.344488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:01.344907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:01.349708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:01.350196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:01.350302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:01.353137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=74 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:01.357892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:01.358380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:01.358818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:01.359545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:01.360051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:01.360421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:01.546893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:01.551523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:01.555448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4b6dabba-a6c2-4d55-ac6a-0e6c611bcae9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.224941 Oct 15 08:47:01.556025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 181/364] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:01 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:01.560420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:01.561992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:01.564020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f456ef17-1bc9-4db2-83da-9e114fb70aac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.219171 Oct 15 08:47:01.564727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 184/365] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:02.578298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:02.578918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:02.585618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:02.586161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:02.586900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:02.587261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:02.587717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:02.588141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:02.589296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:02.589933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:02.596351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:02.596833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:02.597266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:02.597978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:02.598437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:02.598860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:02.786542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:02.792356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:02.795072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fbc1ab43-ebf6-4946-b88b-2c3cf7cefdce tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.220513 Oct 15 08:47:02.795646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 182/366] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:02 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:02.800829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:02.802329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:02.803508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-032620b7-2470-4e29-ac65-b66e921c0b50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.218746 Oct 15 08:47:02.804048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 185/367] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:03.817639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:03.818314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:03.825279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:03.825789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:03.826222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:03.826914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:03.827372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:03.827798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:03.828762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:03.829375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:03.836040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:03.836527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:03.836967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:03.837662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:03.838144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:03.838575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:04.023000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:04.026458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:04.031162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0cc3d4c7-c6e9-4316-89ca-09107b299ef4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.217347 Oct 15 08:47:04.031806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 183/368] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:03 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:04.034669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:04.036104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:04.037250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9461405a-1fe3-47a7-89a9-f322cfb42d51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.212275 Oct 15 08:47:04.037811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 186/369] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:05.054860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:05.055550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:05.058021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:05.063342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:05.063951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:05.064125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:05.064609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:05.065045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:05.065770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:05.066252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:05.066673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:05.070292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:05.070798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:05.071237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:05.072504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:05.072981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:05.073392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:05.257553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:05.264698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:05.265852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9e301098-c511-4e61-92c9-cb521bc8f860 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.214724 Oct 15 08:47:05.266423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 184/370] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:05 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:05.272711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:05.274226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:05.275436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-64f97c03-ede8-44d4-b36e-f384f410ba53 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.216193 Oct 15 08:47:05.276235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 187/371] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:06.288777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:06.289311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:06.295876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:06.296357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:06.296789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:06.297475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:06.297958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:06.298381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:06.300346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:06.300978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:06.307444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:06.307929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:06.308361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:06.309054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:06.309511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:06.309964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:06.491784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:06.494947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:06.499557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4faba90c-a965-4dff-ad1a-bd4221d2f398 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.214695 Oct 15 08:47:06.500126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 185/372] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:06 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:06.503113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:06.504629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:06.505798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e9284ecf-24bf-4332-b857-c53d00a166de tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.209223 Oct 15 08:47:06.506339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 188/373] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:07.522803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:07.523442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:07.530268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:07.530750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:07.531186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:07.531873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:07.532184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:07.532583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:07.532732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:07.532841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:07.539077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:07.539548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:07.539974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:07.540646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:07.541092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:07.541512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:07.725026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:07.729095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:07.732630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a3ab4d90-d6e2-4df0-b17f-cbb93d568804 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.213857 Oct 15 08:47:07.733410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 186/374] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:07 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:07.737449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:07.738911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:07.740041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4b02688-7de7-4a9b-b493-3c4444f95abc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.211684 Oct 15 08:47:07.740580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 189/375] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:08.755428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:08.756147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:08.762641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:08.763122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:08.763554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:08.764233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:08.764644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:08.764732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:08.764841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:08.765092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:08.771085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:08.771564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:08.771992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:08.772674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:08.773150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:08.773572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:08.961056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:08.964874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:08.970070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:08.971511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:08.972610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e95cc225-e736-411c-9529-70f11ca46c0a tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.221083 Oct 15 08:47:08.972736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3219a2d1-21cc-42d5-9e88-50148d09d5da tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.212275 Oct 15 08:47:08.973433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 187/377] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:08 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:08.973545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 190/377] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:09.996876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:09.997640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:10.001611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:10.002485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:10.004079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:10.004567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:10.005005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:10.005725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:10.006347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:10.006781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:10.009097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:10.009642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:10.010128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:10.011329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:10.011776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:10.012309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:10.201133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:10.204444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:10.208728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fd5e1e31-3d27-4092-a6a2-2184b55ded52 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.217380 Oct 15 08:47:10.209295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 188/378] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:09 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:10.212572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:10.214594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:10.215744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3e349dda-dcc4-40d9-a43c-d849dddf558f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.218062 Oct 15 08:47:10.216278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 191/379] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:09 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:11.232383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:11.232998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:11.239573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:11.240060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:11.240448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:11.240863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:11.241053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:11.241159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:11.241605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:11.242054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:11.247496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:11.247981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:11.248415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:11.249104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:11.249557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:11.250016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:11.432716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:11.436703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:11.440335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8d3dac8-e734-47ed-a45c-1c2dd11caca6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.212368 Oct 15 08:47:11.440908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 189/380] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:11 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:11.444992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:11.446464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:11.447611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ddf05856-3600-4612-ac45-6a4618e551fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210959 Oct 15 08:47:11.448669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 192/381] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:12.463332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:12.463921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:12.470481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:12.470988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:12.471400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:12.472094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:12.472550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:12.472982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:12.473478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:12.474121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:12.480962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:12.481438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:12.481900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:12.482589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:12.483044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:12.483493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:12.487378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:12.662268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:12.666242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:12.670495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6872ba20-f6ff-4eaa-9b4e-1e6129910e08 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.211089 Oct 15 08:47:12.671066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 190/382] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:12 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:47:12.675153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:12.676641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:12.677821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5dcdbc9f-b034-449b-8e92-397364cbb4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.208174 Oct 15 08:47:12.678351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 193/383] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:13.693471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:13.694062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:13.700487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:13.700968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:13.701405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:13.701646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:13.702141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:13.702331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:13.702550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:13.702971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:13.708607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:13.709087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:13.709522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:13.710268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:13.710723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:13.711146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:13.891065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:13.894247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:13.898867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ce4c958c-c9f2-41e6-89c8-751d9bd8746e tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.209266 Oct 15 08:47:13.899439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 191/384] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:13 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:13.902833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:13.904294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:13.905490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9fcc53ca-2d5b-453c-a6aa-7e7690f1524d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.207712 Oct 15 08:47:13.906040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 194/385] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:14.921662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:14.922300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:14.928700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:14.929177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:14.929607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:14.930307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:14.930758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:14.930900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:14.931306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:14.931501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:14.938375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:14.938845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:14.939270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:14.939946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:14.940387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:14.940801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:15.124306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:15.128110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:15.131955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6ce3f3fa-e5f7-4c4d-9df1-f57c4df1b23b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.214095 Oct 15 08:47:15.132515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 192/386] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:14 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:15.136889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:15.138336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:15.139471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5f0b88a5-22b2-48d5-b856-8ddf8d89f06f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.212396 Oct 15 08:47:15.140184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 195/387] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:16.156941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:16.157545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:16.164161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:16.164640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:16.164771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:16.165178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:16.165414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:16.165753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:16.166206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:16.166683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:16.171809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:16.172287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:16.172746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:16.173561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:16.174037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:16.174459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:16.355738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:16.363751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-30ab0a80-afcf-4602-a239-fc516a529e98 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.210236 Oct 15 08:47:16.364404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 193/388] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:16 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:16.369138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:16.377855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:16.379281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:16.380409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c95291a4-fb0d-4921-ad6b-1807cbd5f267 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.219486 Oct 15 08:47:16.380952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 196/389] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:17.387286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:17.388066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:17.394495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:17.394984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:17.395423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:17.396117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:17.396579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:17.397004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:17.406988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:17.407532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:17.413839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:17.414320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:17.414753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:17.415438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:17.415891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:17.416319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:17.591992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:17.596153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:17.599589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5d2afe94-f226-4d83-8a16-57468148a516 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.216675 Oct 15 08:47:17.600152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 194/390] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:17 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:17.604186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:17.605636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:17.606796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-88983b85-94dd-4cf2-9c1e-1fe554aad983 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.203797 Oct 15 08:47:17.607328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 197/391] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:18.622630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:18.623236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:18.630014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:18.630494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:18.630923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:18.631232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:18.631623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:18.631836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:18.632051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:18.632454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:18.638185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:18.638661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:18.639093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:18.639798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:18.640249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:18.640671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:18.822706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:18.826696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:18.830789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-03570b47-df8c-42c0-a9a3-72a7feb1e0e9 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.211950 Oct 15 08:47:18.831358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 195/392] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:18 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:18.834930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:18.836439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:18.837693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-48b651a6-321f-4dc2-abf7-9ebeba08f4a5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210251 Oct 15 08:47:18.838309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 198/393] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:19.853731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:19.854831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:19.861528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:19.862056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:19.862491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:19.862943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:19.863351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:19.863546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:19.863651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:19.864076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:19.869542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:19.870653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:19.871085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:19.871769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:19.872222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:19.872645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:20.049161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:20.057152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d72411e7-18bd-4552-b04f-9216f9f06927 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.206930 Oct 15 08:47:20.057615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 196/394] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:19 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:20.059530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:20.067636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:20.069052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:20.070227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-27450838-9a67-4462-801e-e7b1857a5730 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.211088 Oct 15 08:47:20.070765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 199/395] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:21.080020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:21.080559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:21.086940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:21.087419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:21.087853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:21.088542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:21.088991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:21.089409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:21.094951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:21.095573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:21.101833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:21.102316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:21.102748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:21.103431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:21.103879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:21.104297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:21.271136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:21.274616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:21.280255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8081d7fb-7f8e-4736-aa31-39f8d5c3c393 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.204153 Oct 15 08:47:21.280831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 197/396] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:21 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:21.288464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:21.297134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:21.298592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:21.299732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-094fc46a-f715-4ccb-8c06-01d8d9c4a482 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.208665 Oct 15 08:47:21.300275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 200/397] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:22.303432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:22.304051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:22.311125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:22.311610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:22.312042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:22.312727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:22.313186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:22.313608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:22.325420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:22.326049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:22.332366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:22.332849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:22.333282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:22.333996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:22.334454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:22.334881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:22.512922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:22.520541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:22.521432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bf1fe460-3e60-4e6a-9139-37635330322b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.221550 Oct 15 08:47:22.522224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 198/398] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:22 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:22.529434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:22.531167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:22.532390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b897fde9-eee4-451f-a91a-2052040cdc0c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.211371 Oct 15 08:47:22.533001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 201/399] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:22 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:23.544168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:23.545432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:23.554057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:23.554815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:23.555372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:23.556359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:23.557174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:23.557335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:23.557882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:23.558436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:23.564568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:23.565135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:23.565694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:23.566494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:23.567020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:23.567518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:23.751439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:23.759349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe86953b-4bd9-492b-bc3e-ab25afbb9904 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.219016 Oct 15 08:47:23.759915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 199/400] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:23 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:23.762565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:23.770584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:23.772000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:23.773133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-60c37d3c-5c5f-4ecd-8c43-8d64e0179a25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.219961 Oct 15 08:47:23.773671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 202/401] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:24.782705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:24.783318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:24.789704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:24.790187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:24.790619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:24.791300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:24.792376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:24.792799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:24.802430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:24.803126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:24.816300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:24.816782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:24.817209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:24.818125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:24.818575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:24.818994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:24.983293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:24.989889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:24.990994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b4546235-2f82-4da0-9c62-8f1910427a6b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.212024 Oct 15 08:47:24.991566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 200/402] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:24 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:24.998365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:24.999788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:25.000925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2bfbbb77-28b3-4f20-adb6-3e6cfc672677 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.206262 Oct 15 08:47:25.001461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 203/403] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:26.013774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:26.014394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:26.020814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:26.021293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:26.021744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:26.022672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:26.023125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:26.023547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:26.027354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:26.027963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:26.034013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:26.034495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:26.034932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:26.035617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:26.036071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:26.036497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:26.214780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:26.222394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b2c650f7-db04-4859-b603-f871559818b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.212502 Oct 15 08:47:26.223132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 201/404] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:26 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:26.226231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:26.234978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:26.236414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:26.237556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-80c94978-bf88-437c-a5f4-aea350a7edd2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.214519 Oct 15 08:47:26.238134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 204/405] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:27.246324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:27.246941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:27.249312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=50 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:27.254504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:27.254989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:27.255420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:27.256115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:27.256567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:27.256990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:27.262556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:27.263172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:27.269708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:27.270210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:27.270634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:27.271320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:27.272136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:27.272267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:27.446928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:27.453746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:27.454917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86869d24-9662-4c9f-9c58-9d9193d7b76d tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.213103 Oct 15 08:47:27.455564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 202/406] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:27 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:27.462133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:27.463581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:27.464724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dacd8b60-a36d-4fd7-8275-a53af4cec190 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.206052 Oct 15 08:47:27.465258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 205/407] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:28.477140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:28.477705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:28.484202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:28.484693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:28.485123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:28.485854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:28.486311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:28.486739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:28.490223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:28.490827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:28.497663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:28.498184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:28.498612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:28.499301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:28.499754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:28.500174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:28.675752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:28.684366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-300e55cd-f4c3-42ca-9726-db243f7347b4 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.211325 Oct 15 08:47:28.684779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 203/408] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:28 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:28.686850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:28.695258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:28.696734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:28.698136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3da2c80c-d2c1-42b9-8db8-ab0d3d067897 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.211516 Oct 15 08:47:28.698671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 206/409] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:29.706596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:29.707210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:29.714222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:29.714707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:29.715138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:29.715818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:29.716270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:29.716689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:29.723064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:29.723669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:29.729967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:29.730452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:29.730882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:29.731580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:29.732038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:29.732462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:29.911988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:29.913535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:29.920339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c4542e9b-e20a-4203-b862-e93d378f7036 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.217476 Oct 15 08:47:29.922371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:29.924033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:29.925399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d00bf7eb-acde-41b3-8740-2a8cdf232183 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.206128 Oct 15 08:47:29.939104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 204/410] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:29 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:29.943259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 207/411] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:30.943871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:30.944526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:30.951477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:30.951898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:30.953931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:30.954050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:30.954050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:30.954524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:30.954524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:30.954666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:30.959764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:30.960253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:30.960678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:30.961352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:30.961983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:30.962280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:31.148371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:31.152604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:31.156495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f57ce745-40e8-4303-936e-009d7c22cab8 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.216534 Oct 15 08:47:31.157073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 205/412] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:30 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:31.161093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:31.162536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:31.163665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f6892e0-d5a9-4df1-92d0-1bd9908ec74c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.214809 Oct 15 08:47:31.164200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 208/413] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:30 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:32.178872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:32.179512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:32.185892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:32.186380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:32.186814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:32.187500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:32.187952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:32.188375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:32.190001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:32.190603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:32.192871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=50 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:32.198225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:32.198700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:32.199126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:32.199804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:32.200251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:32.200671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:32.370215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:32.377862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5fbe375a-255e-4615-b572-8cb33316ba02 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.202766 Oct 15 08:47:32.378436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 206/414] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:32 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:32.380792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:32.384387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:32.400124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:32.402550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:32.403741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4f6c411e-afba-42ab-a11a-aa4a54a6d75d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.217537 Oct 15 08:47:32.404316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 209/415] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:33.401446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:33.402163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:33.408509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:33.408983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:33.409411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:33.410121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:33.410572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:33.410987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:33.428589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:33.429185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:33.436223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:33.436698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:33.437125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:33.437825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:33.438273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:33.438689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:33.606949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:33.610191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:33.614645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-53162264-51e6-4246-9505-4254e6237ea7 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.217261 Oct 15 08:47:33.615221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 207/416] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:33 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:33.618374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:33.620500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:33.621902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a374409b-e281-4908-a6f7-c7dd1be8dda2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.197385 Oct 15 08:47:33.622440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 210/417] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:34.637891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:34.638562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:34.645163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:34.645642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:34.646110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:34.646796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:34.647252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:34.647675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:34.647780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:34.648330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:34.655004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:34.655420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:34.655853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:34.656540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:34.656994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:34.657419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:34.839800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:34.843706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:34.847506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-36720c7b-4375-4f86-b406-f324bb412776 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.214015 Oct 15 08:47:34.848077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 208/418] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:34 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:34.851708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:34.853132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:34.854827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c7e3ecab-798d-4166-9654-247dfeb1ecc8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210907 Oct 15 08:47:34.855360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 211/419] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:35.869960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:35.870570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:35.877299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:35.877809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:35.878257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:35.878949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:35.879405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:35.879848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:35.880116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:35.880728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:35.888085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:35.888573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:35.889008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:35.889713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:35.890172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:35.890597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:36.074123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:36.077498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:36.082531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:36.084198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:36.085607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-65d92640-27f1-4eb8-bb36-539a035b08e6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.219260 Oct 15 08:47:36.085783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-34490bd2-532a-4749-9f5c-2d667627832b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.209366 Oct 15 08:47:36.086259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 209/420] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:35 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:36.086625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 212/421] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:37.109343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:37.109955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:37.112191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:37.112800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:37.116038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:37.116509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:37.116935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:37.117610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:37.118095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:37.118495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:37.118601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:37.119057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:37.119495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:37.120212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:37.120667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:37.121092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:37.553910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:37.557440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:37.562047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-757b9011-cb62-42f0-8392-5b2225f9070f tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.456522 Oct 15 08:47:37.562621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 210/422] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:37 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:37.565521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:37.567043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:37.568200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8df19a59-4afd-44d8-8bb4-1ac65959935f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.459993 Oct 15 08:47:37.568739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 213/423] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:37 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:38.586272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:38.586798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:38.593965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:38.594379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:38.594810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:38.594914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:38.595006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:38.595546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:38.596034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:38.596458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:38.601335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:38.601846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:38.602275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:38.602951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:38.603404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:38.603894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:38.778121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:38.785746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-84c5079b-46d2-4ae6-bd9f-b7ddcfa306c3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.203705 Oct 15 08:47:38.786655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 211/424] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:38 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:38.789528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:38.797966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:38.799396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:38.800540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0da1415b-c572-427b-814e-cdd1b43662ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210098 Oct 15 08:47:38.801082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 214/425] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:39.808266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:39.808880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:39.815267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:39.815746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:39.816174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:39.816860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:39.817309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:39.817757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:39.826417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:39.827028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:39.833359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:39.833882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:39.834320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:39.835043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:39.835506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:39.835930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:40.017770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:40.021442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:40.025479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ef6b342a-5988-4474-95d9-152dfd36b40b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.221099 Oct 15 08:47:40.027251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 212/426] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:39 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:40.030524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:40.031961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:40.033126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8f66cef3-29ca-4eb2-937d-8db707e3881c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.210647 Oct 15 08:47:40.033652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 215/427] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:41.049017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:41.049622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:41.056229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:41.056725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:41.057198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:41.057659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:41.058076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:41.058314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:41.058421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:41.058779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:41.064599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:41.065021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:41.065448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:41.066151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:41.066600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:41.067014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:41.247135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:41.251072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:41.254821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-27113589-dd4e-4122-88f2-7a6d8baa9f71 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.209539 Oct 15 08:47:41.255399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 213/428] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:41 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:41.259069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:41.260548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:41.261687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b08c9116-9281-4107-91eb-0635c13c2e02 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.207858 Oct 15 08:47:41.262235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 216/429] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:42.277850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:42.278458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:42.284977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:42.285449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:42.285927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:42.286660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:42.287070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:42.287469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:42.287580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:42.287672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:42.294595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:42.295071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:42.295561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:42.296265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:42.296716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:42.297137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:42.305605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:42.518030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:42.526682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7b828982-7b99-494e-adf7-b3595fb13ca3 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.252135 Oct 15 08:47:42.527251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 214/430] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:42 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:42.533549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:42.542581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:42.543987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:42.545491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-97c37ec0-02f0-4d86-ab08-8772fb9f88db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1724 microversion: 2.20 time: 0.262265 Oct 15 08:47:42.557853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 217/431] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:43.553619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:43.554248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:43.561126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:43.561597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:43.562058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:43.562734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:43.563184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:43.563604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:43.570827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:43.571493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:43.578565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:43.579047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:43.579476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:43.580159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:43.580608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:43.581028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:43.758000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:43.765877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bef647cd-0469-4b52-a707-a65a8acfee69 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.215998 Oct 15 08:47:43.766529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 215/432] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:43 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:43.778398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:43.786410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:43.787834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:43.789004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-32df499c-dac7-4b92-bb1c-2825f49bb1ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1745 microversion: 2.20 time: 0.222050 Oct 15 08:47:43.789539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 218/433] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:44.242542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:47:44.248535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.249014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.249441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.312398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Going to try to stop instance {{(pid=125329) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 15 08:47:44.357703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb3f53e0-dcab-4141-8ea7-3cc63c219963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.118853 Oct 15 08:47:44.358552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 216/434] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 08:47:44 2022] POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:47:44.366249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:44.366848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:44.372609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.373092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.373521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.374220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.374725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.375342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.562295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:44.571697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-505f93d5-e373-472c-a669-9cf6f2736c5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.209181 Oct 15 08:47:44.572982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 219/435] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:44.789228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:44.790037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:44.796727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.797213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.797648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.798357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.798811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.799232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.815149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:44.815791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:44.823050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.823527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.823958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.824663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:44.825106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:44.825529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:44.989600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:44.997237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c124134b-b99f-4e11-9303-1fc64f8f4431 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.212645 Oct 15 08:47:44.997837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 217/436] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:44 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:45.000838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:45.008869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:45.010336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:45.011478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a2effae6-320b-4597-bcba-1624d9bcbe2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1745 microversion: 2.20 time: 0.200805 Oct 15 08:47:45.012014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 220/437] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:45.595976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:45.596586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:45.602701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:45.603162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:45.604218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:45.604914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:45.605365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:45.605909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:45.735971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:45.744162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8d10d1ff-0b59-4085-8483-badd8e3e148c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.152327 Oct 15 08:47:45.744839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 218/438] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:46.019947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:46.020547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.027959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.028441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.028869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.029555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.030030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.030445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.037593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:46.038468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.045351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.046129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.046777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.047912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.048548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.049189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.260469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.263239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.269725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9874aa94-6ee2-450a-9486-3e7734698db6 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1501 microversion: 2.1 time: 0.253573 Oct 15 08:47:46.270290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 221/439] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:46 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1501 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:46.271833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.273485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.274820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-15aac58a-60fe-4dd3-acaf-7d14890b3b36 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1745 microversion: 2.20 time: 0.241365 Oct 15 08:47:46.274957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "name": "network-vif-plugged", "status": "completed", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:47:46.276054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 219/440] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1745 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:46.295227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27bdd865-7feb-4771-9cd9-f2594f98d30e"}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:47:46.297953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.303917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.304161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.304422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.304838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.304953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.305811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.307260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.307848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.308307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.316459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] Creating event network-vif-plugged:3717c011-fe4a-413f-b1ef-15aff3def419 for instance 5a4919f4-824b-4aec-8131-eabe4e8995df on hv-cinder-85697 Oct 15 08:47:46.321485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-b46146b2-9247-401d-9c09-3bca02163344 req-45600899-8112-4ce8-ad99-825b95d20aec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049940 Oct 15 08:47:46.322100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 222/441] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:47:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:47:46.333296 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] HTTP exception thrown: Cannot 'attach_volume' instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff while it is in vm_state rescued Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Request method failure captured: Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/os-volume_attachments HTTP/1.1 Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 74 Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL4Fl4WOwKbjND5c9pmR9PXLjRefQ9qg1p4lrjbZuVHG-rAeZn1P4K65sLTWqijuhFBZ1H0WqGElufJd0rjJDDNUM2Ug6fFXNkwrbusshlo3SMtntWfM5eM3EIgyt3FNcC8yLLJeNThQXkZbtIAQ4cgZctVLzIRxG10RoQ9Xlg_Gvg Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:47:46.334997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f67051bce2414ff791a2a1e1a638cadc", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 9cc9e2cf11804cc39a7de3c314e46679 Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {"volumeAttachment": {"volumeId": "27bdd865-7feb-4771-9cd9-f2594f98d30e"}} Oct 15 08:47:46.336432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Cannot 'attach_volume' instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff while it is in vm_state rescued Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'server_id': '60a56b6e-d8d1-4f32-b72f-d1d4135779ff', 'body': {'volumeAttachment': {'volumeId': '27bdd865-7feb-4771-9cd9-f2594f98d30e'}}} Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:47:46.337366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff while it is in vm_state rescued Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:47:46.338925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff while it is in vm_state rescued Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Returning 409 to user: Cannot 'attach_volume' instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff while it is in vm_state rescued {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c02b10e3-2307-4417-b327-083054a01470 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045386 Oct 15 08:47:46.340451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 220/442] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 08:47:46 2022] POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 15 08:47:46.346039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:47:46.346685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.352825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.353307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.353825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.354505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.354952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.355367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.428023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2a1cc360-45e7-4bc3-bf37-baee6a58ba37 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/action" status: 202 len: 0 microversion: 2.1 time: 0.086215 Oct 15 08:47:46.428651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 223/443] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 08:47:46 2022] POST /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:47:46.437733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:46.438694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.446940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.448126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.448695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.449488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.450169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.450588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.668793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.687026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3a78ba3b-c26c-4e41-9813-95f21984a006 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1509 microversion: 2.1 time: 0.253484 Oct 15 08:47:46.688334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 221/444] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:46 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:46.767821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:46.768548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:46.775503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.775915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.776881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.777775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:46.778403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:46.778969 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:46.957029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:46.965297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2222e2e8-c603-431a-925a-7b8611a59b9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.201670 Oct 15 08:47:46.965896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 224/445] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:47.307309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:47.309879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:47.318373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:47.322390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:47.323198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:47.324519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:47.325196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:47.326010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:47.509067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:47.520882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:47.522340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:47.523519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-67f55c54-aa56-4d9e-90b3-86c87182f7e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.221803 Oct 15 08:47:47.524543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 222/446] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:47.711280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:47.711919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:47.721801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:47.722287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:47.722723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:47.723410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:47.723860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:47.724273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:47.862307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:47.871897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e7671aa5-331b-48c4-b7db-b2cbe871c12b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1509 microversion: 2.1 time: 0.164548 Oct 15 08:47:47.876654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 225/447] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:47 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:47.988423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:47.989305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:47.998088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:47.998717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:47.999163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:47.999886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:48.000338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:48.000765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:48.160702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:48.174554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-54c0e694-cf7b-42ae-90b8-067b57a4faf4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.189796 Oct 15 08:47:48.175141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 223/448] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:48.552171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:48.552778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:48.559337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:48.560184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:48.560678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:48.561443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:48.562147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:48.562816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:48.567350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:48.704551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:48.713621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:48.715159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:48.716595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a1f6a621-e88a-4d8c-a7e2-0bcf71f9f441 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.168185 Oct 15 08:47:48.717153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 226/449] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:48.899786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:48.901318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:48.908593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:48.909172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:48.909701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:48.910481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:48.911204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:48.911822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:49.136961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:49.181396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ba4b76a8-99d7-4c94-990e-f93b04366892 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1509 microversion: 2.1 time: 0.284568 Oct 15 08:47:49.182546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 224/450] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:48 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:49.210359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:49.211386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:49.233808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:49.234411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:49.234906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:49.235700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:49.237635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:49.237635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:49.422390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:49.431423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-41fe082d-37ee-40ca-853a-fbe5998ce9fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.228533 Oct 15 08:47:49.433724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 227/451] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:49.743098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:49.743713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:49.750769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:49.751245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:49.751669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:49.752384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:49.752828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:49.753242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:49.927208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:49.940169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:49.942112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:49.943857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e26379f8-3596-4d38-bde0-57cd321987d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.204628 Oct 15 08:47:49.944592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 225/452] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:50.207270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:50.207968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:50.216178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.216684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.217116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:50.218500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.219098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.219530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:50.374698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:50.382787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-67b2253f-cd44-4563-84fd-9f253d933281 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1515 microversion: 2.1 time: 0.180951 Oct 15 08:47:50.398385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 228/453] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:50 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:50.456006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:50.456907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:50.463980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.464731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.465364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:50.466302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.466948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.467561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:50.608632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:50.620947 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3f260a80-7b18-4e62-8533-43fda6ce94c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.168838 Oct 15 08:47:50.622948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 226/454] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:47:50.972437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:50.973039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:50.979411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.979892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.980368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:50.981356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:50.981833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:50.982465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:51.195203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:51.203504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:51.204938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:51.207140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ffcceb76-8d6e-4c69-9908-7eef2870e073 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.241456 Oct 15 08:47:51.222433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 229/455] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:51.646501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:51.647041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:51.660571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:51.661087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:51.661740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:51.662620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:51.663092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:51.663517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:51.813839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:51.822787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-723dadb5-60cd-4b74-a9ad-17bc539ddf7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.180239 Oct 15 08:47:51.823849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 227/456] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:52.234353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:52.235675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:52.242514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:52.244822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:52.249829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:52.250748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:52.251358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:52.251945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:52.451238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:52.467072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:52.468603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:52.469993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1612b7bf-7611-4f2a-9423-416c0c57fe87 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.239556 Oct 15 08:47:52.471063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 230/457] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:47:52.854803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:52.856787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:52.866316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:52.867280 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:52.868178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:52.870023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:52.870690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:52.871372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:53.060628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:53.068967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e8e7487d-46d6-47eb-808f-b4276ca4ae9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.221532 Oct 15 08:47:53.071034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 228/458] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:53.506609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:53.507226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:53.513939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:53.514418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:53.514849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:53.515672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:53.516259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:53.516684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:53.668008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:53.677141 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:53.679076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:53.680565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6fc67acc-977c-4188-8012-9dfacc55ac2c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.180074 Oct 15 08:47:53.681365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 231/459] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:54.096366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:54.097728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:54.106248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:54.106825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:54.107330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:54.108094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:54.108787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:54.109403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:54.273304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:54.282869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-56e59c00-e7dc-4dff-a0da-2989d871c577 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1724 microversion: 2.1 time: 0.190361 Oct 15 08:47:54.297771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 229/460] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:54.725242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:54.726505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:54.729720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:47:54.730079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:47:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:47:54.737164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:54.737702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:54.738157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:54.739057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:54.739502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:54.739923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:54.915589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:54.931569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:54.933041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:54.934300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-03e30046-87ac-4c85-8670-da7258dc78d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.228059 Oct 15 08:47:54.934846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 232/461] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:55.308787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:55.309507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:55.320567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.321052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.321484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.323236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.325086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.326912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.350004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:55.529378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:55.538556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-694559d2-5979-4d27-8fe3-d3da986808aa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1701 microversion: 2.1 time: 0.234132 Oct 15 08:47:55.554118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 230/462] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1701 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:55.562973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:47:55.569923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.570492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.571003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.638900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Going to try to start instance {{(pid=125327) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 15 08:47:55.693306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-59d83ba9-b2c8-422e-a017-0d71311a0149 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.133711 Oct 15 08:47:55.693777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 233/463] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 08:47:55 2022] POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:47:55.703040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:55.703927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:55.711437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.711936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.712368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.713162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.713855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.714493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.963304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:55.964391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:55.972005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:55.976676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.979416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.980123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.981361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:55.982908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:55.984279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:55.988319 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aade0c4d-cc68-4871-ad4a-1127cfaa666e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1710 microversion: 2.1 time: 0.289189 Oct 15 08:47:55.988918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 231/464] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1710 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:47:56.227133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:56.236439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:56.238172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:56.239681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-522d4c20-b5e6-4cf1-a546-7de6b388da26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1740 microversion: 2.20 time: 0.282661 Oct 15 08:47:56.250300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 234/465] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1740 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:57.011932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:57.012546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:57.018966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:57.019446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:57.019877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:57.020558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:57.021016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:57.021435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:57.156020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:57.164393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bc4de9e9-5685-4976-b010-ed09c3775c13 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1710 microversion: 2.1 time: 0.156345 Oct 15 08:47:57.164969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 232/466] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:57.265805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:57.266404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:57.272819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:57.273300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:57.273781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:57.274439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:57.274886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:57.275954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:57.407765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:57.416358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:57.417830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:57.418977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-31c2f3d4-162e-4610-94bf-c8ced1aa851c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1722 microversion: 2.20 time: 0.157119 Oct 15 08:47:57.419525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 235/467] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:58.188557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:58.189167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:58.191559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=62 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:47:58.196845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:58.197889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:58.198734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:58.199786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:58.200242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:58.200662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:58.330089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:58.338707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fca33843-5012-4ca7-8154-4da2ff626e3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1714 microversion: 2.1 time: 0.154794 Oct 15 08:47:58.339264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 233/468] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:47:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:47:58.444292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:58.444856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:58.452005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:58.452482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:58.452906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:58.453582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:58.454055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:58.454474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:58.830899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:58.838837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:58.840264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:47:58.841392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ddc21b94-3e84-4c57-aa08-9a345818d8e9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1722 microversion: 2.20 time: 0.401011 Oct 15 08:47:58.842044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 236/469] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:47:59.867336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:47:59.867966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:47:59.874103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:59.874586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:59.875021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:47:59.875717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:47:59.876175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:47:59.876618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:00.024403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:00.034295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:00.035730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:00.037153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e3971ba-9e06-4a59-be86-38e73888b155 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1722 microversion: 2.20 time: 0.173588 Oct 15 08:48:00.037937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 234/470] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:47:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:00.107382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "name": "network-vif-unplugged", "status": "completed", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:48:00.119217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:00.119726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:00.120118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:00.131521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] Creating event network-vif-unplugged:3717c011-fe4a-413f-b1ef-15aff3def419 for instance 5a4919f4-824b-4aec-8131-eabe4e8995df on hv-cinder-85697 Oct 15 08:48:00.137138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-4f9c0b1c-da27-4b0a-a5ca-ecff62411504 req-468453e6-6bb1-4cda-b5fa-e039c02ca581 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034074 Oct 15 08:48:00.138319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 237/471] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:48:01.063690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:01.064302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:01.071272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.071758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.072191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.072883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.073337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.073796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.202030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:01.210023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:01.213453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:01.214641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8fce9317-5e14-4694-bb65-762fa77a5090 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1665 microversion: 2.20 time: 0.154845 Oct 15 08:48:01.215204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 235/472] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:01.240877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76ba6eaf-7abd-4fde-bf84-8c53a1416815"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:48:01.243335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:01.250691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.251170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.251604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.252290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.252740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.253160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.551848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eff84b0c-3e3f-4205-b8d1-ad9af30889f6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315729 Oct 15 08:48:01.552475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 238/473] 10.222.0.30 () {62 vars in 1364 bytes} [Sat Oct 15 08:48:01 2022] POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:48:01.675986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:48:01.676581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:01.682623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.683098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.683523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.684200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:01.684647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:01.685066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:01.728826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125329) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 15 08:48:01.794248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [6810e88e-90be-408b-91cb-6e5460c1e935] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 08:48:02.801670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [6810e88e-90be-408b-91cb-6e5460c1e935] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 37890. Oct 15 08:48:02.804739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-64982d26-a5c9-4f60-95fa-c7cb4bb1f346 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/action" status: 202 len: 0 microversion: 2.20 time: 1.132643 Oct 15 08:48:02.805352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 236/474] 10.222.0.30 () {62 vars in 1319 bytes} [Sat Oct 15 08:48:01 2022] POST /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:48:02.813956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:02.814558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:02.816921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=60 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:02.823578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:02.824074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:02.824503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:02.825187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:02.825635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:02.826234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:02.974802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:02.978315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:02.984659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:02.986183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:02.987327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-94eb6385-7d75-4d1c-b64c-17a831cab5f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1751 microversion: 2.20 time: 0.177255 Oct 15 08:48:02.987867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 239/475] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:04.013150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:04.013875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:04.019755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:04.020232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:04.020663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:04.021345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:04.021818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:04.022237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:04.151425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:04.160263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:04.161713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:04.162843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e3a6a038-a341-487e-84a0-0d3be95a62cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154499 Oct 15 08:48:04.163386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 237/476] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:04 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:05.188204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:05.188808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:05.196224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:05.196706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:05.197142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:05.197865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:05.198319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:05.198743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:05.323779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:05.332263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:05.333722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:05.334914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-06635147-8285-4f45-bccd-5a1b42d61ea7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151178 Oct 15 08:48:05.335467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 240/477] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:06.360263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:06.360795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:06.367675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:06.368153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:06.368584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:06.369926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:06.370378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:06.370799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:06.496742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:06.505252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:06.506716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:06.507860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-10da4f59-5826-4222-bfa4-a09a4236c28b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151522 Oct 15 08:48:06.508412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 238/478] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:07.533885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:07.534485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:07.540554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:07.541011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:07.541432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:07.542130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:07.542573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:07.542987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:07.667355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:07.676077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:07.677625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:07.678825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5f880601-0f95-482a-9421-f0b0164d6be3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148797 Oct 15 08:48:07.679373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 241/479] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:08.706023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:08.706664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:08.713395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:08.713906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:08.714336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:08.715023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:08.715472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:08.715892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:08.841538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:08.850002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:08.851427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:08.852579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2066b7e7-6670-443c-95ed-9e456f112a84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150428 Oct 15 08:48:08.853153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 239/480] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:09.878072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:09.878680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:09.885579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:09.886089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:09.886519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:09.887200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:09.887653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:09.888081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:10.015138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:10.023631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:10.025670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:10.027079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bf753496-da25-418b-8c71-4b6993eceabb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152584 Oct 15 08:48:10.027621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 242/481] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:09 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:11.051942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:11.052549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:11.059027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:11.059453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:11.059885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:11.060570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:11.061020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:11.061440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:11.185356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:11.193859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:11.195289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:11.196444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a2bcb908-272a-4668-a997-f64a7f8f3c09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148361 Oct 15 08:48:11.196993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 240/482] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:12.222182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:12.222760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:12.229011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:12.229491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:12.229957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:12.230641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:12.232365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:12.232811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:12.358883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:12.367344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:12.368815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:12.369982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-23237677-e244-44e1-88d8-1ea180438359 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151718 Oct 15 08:48:12.370521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 243/483] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:13.395343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:13.395960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:13.403244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:13.403725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:13.404155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:13.404840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:13.405292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:13.405747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:13.538828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:13.548009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:13.549461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:13.550643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-25989b93-7636-4e3a-a4fc-10f18e9c7daa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.159207 Oct 15 08:48:13.551206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 241/484] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:14.575961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:14.576785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:14.583467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:14.584018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:14.584524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:14.585228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:14.585713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:14.586192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:14.712221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:14.721169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:14.722615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:14.723754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-903c303d-8b7c-4607-98ad-bb7f3397a5b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151727 Oct 15 08:48:14.731438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 244/485] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:15.749632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:15.750268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:15.756569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:15.757047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:15.757485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:15.758196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:15.758649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:15.759069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:15.890811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:15.899275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:15.900701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:15.902140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ea5bfb61-fda5-49dd-812f-f90da9dc0db9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156616 Oct 15 08:48:15.902699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 242/486] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:15 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:16.927102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:16.927645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:16.934592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:16.935075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:16.935508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:16.936195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:16.936648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:16.937073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:17.066650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:17.075738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:17.077186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:17.078415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-10bf0831-1912-4ed3-97bd-6a4290000ba2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155228 Oct 15 08:48:17.078989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 245/487] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:18.103528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:18.104136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:18.110600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:18.111080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:18.111510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:18.112196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:18.112651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:18.113073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:18.243791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:18.252362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:18.253866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:18.255021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-58a2e415-4305-4b78-9ec1-deab7e5d2776 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155336 Oct 15 08:48:18.255576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 243/488] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:19.281221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:19.281852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:19.288455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:19.288933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:19.289362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:19.290072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:19.290521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:19.290939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:19.419443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:19.427840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:19.429257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:19.430422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6e9172dc-3236-4815-91b9-ba4e9748e030 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153847 Oct 15 08:48:19.430961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 246/489] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:20.455034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:20.455638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:20.462573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:20.463065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:20.463503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:20.464202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:20.464661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:20.465086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:20.593465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:20.601869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:20.603287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:20.604427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4b69edcb-7971-4446-9f1d-c58de1425c1f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153212 Oct 15 08:48:20.604972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 244/490] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:21.630927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:21.631530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:21.638744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:21.639222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:21.639653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:21.640340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:21.640793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:21.641216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:21.766966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:21.775378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:21.776790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:21.778906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-29a2825c-a760-4bd1-a093-25282056dfee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151886 Oct 15 08:48:21.779439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 247/491] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:22.804367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:22.804969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:22.811126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:22.811597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:22.812018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:22.812692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:22.813135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:22.813551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:22.939411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:22.947916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:22.949929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:22.951064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17291370-ad68-458a-9f56-9a140a01982d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150702 Oct 15 08:48:22.951617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 245/492] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:22 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:23.975675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:23.976281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:23.983296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:23.983770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:23.984201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:23.984878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:23.985332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:23.985784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:24.117598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:24.126818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:24.128258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:24.129425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-67941e11-7623-4560-9b02-bec3b01cb8fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.157648 Oct 15 08:48:24.130015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 248/493] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:25.164979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:25.164979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:25.164979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:25.164979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:25.165598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:25.165598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:25.165598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:25.165598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:25.169626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:25.294793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:25.303249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:25.304674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:25.305861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-43c577fa-295c-4e02-a3cc-15d80b592e90 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154572 Oct 15 08:48:25.306423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 246/494] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:26.331276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:26.331880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:26.338247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:26.338725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:26.339155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:26.339834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:26.340290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:26.340708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:26.469261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:26.477637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:26.479076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:26.480221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5873940e-f607-43cc-9623-da5e96cdcd18 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152781 Oct 15 08:48:26.480759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 249/495] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:27.506339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:27.506941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:27.513911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:27.514384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:27.514812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:27.515487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:27.515933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:27.516347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:27.639361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:27.647850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:27.649283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:27.650459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3b2cc80a-c687-417c-a051-e65525a864e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148064 Oct 15 08:48:27.651015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 247/496] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:28.676331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:28.676932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:28.683298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:28.683776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:28.684208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:28.684891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:28.685364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:28.685814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:28.809616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:28.818119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:28.819554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:28.820700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-438400a0-944a-4db0-8b44-6fbdd64c2647 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148248 Oct 15 08:48:28.821251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 250/497] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:29.847532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:29.848132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:29.850456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:29.855540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:29.856009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:29.856434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:29.857738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:29.858189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:29.858605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:29.991255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:30.000511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:30.001964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:30.003115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-64bc2aa4-a45a-42ff-b42b-6aeb041a4fe4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.159464 Oct 15 08:48:30.003667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 248/498] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:31.029285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:31.029922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:31.036381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:31.036857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:31.037290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:31.037992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:31.038444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:31.038862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:31.162417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:31.171397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:31.172834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:31.174010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b368091b-e241-454b-ab13-be7065d5df41 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148950 Oct 15 08:48:31.174559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 251/499] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:48:31.372290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:31.372738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:31.379205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:31.379678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:31.380103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:31.380781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:31.381224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:31.381640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:31.541057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lazy-loading 'services' on Instance uuid 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:48:31.655906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1da0b247-4c05-4613-8aa6-b40819f6cf1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments/3cc4d512-e380-4e9b-8c35-477c7d66eb5b" status: 202 len: 0 microversion: 2.1 time: 0.287447 Oct 15 08:48:31.656493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 249/500] 10.222.0.30 () {58 vars in 1416 bytes} [Sat Oct 15 08:48:31 2022] DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments/3cc4d512-e380-4e9b-8c35-477c7d66eb5b => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:48:32.199262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:32.199863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:32.206963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:32.207438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:32.207871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:32.208547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:32.208997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:32.209419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:32.337458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:32.346054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:32.347483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:32.348621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-03b03793-2877-4bdc-9639-4c48ff268ec5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153192 Oct 15 08:48:32.349157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 252/501] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:33.374944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:33.375635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:33.381829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:33.382306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:33.382737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:33.383419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:33.383868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:33.384290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:33.510040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:33.519066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:33.520499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:33.521652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a0ecfccd-a0bd-475e-b87e-05ebc2b102d4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151441 Oct 15 08:48:33.522226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 250/502] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:34.547783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:34.548388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:34.550748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=28 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:34.555952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:34.556430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:34.556865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:34.557546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:34.558029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:34.558455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:34.690708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:34.699275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:34.700707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:34.701888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4a2cdd96-bee4-4ced-9e90-5d1e079399ac tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.158522 Oct 15 08:48:34.702603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 253/503] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:35.727049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:35.727650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:35.734627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:35.735098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:35.735520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:35.736194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:35.736640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:35.737055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:35.866518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:35.874944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:35.876364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:35.877503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c3fdfa37-a43a-4e21-91b4-a46d3f07a716 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154255 Oct 15 08:48:35.878094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 251/504] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:36.902762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:36.903386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:36.910045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:36.910521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:36.910935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:36.911611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:36.912056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:36.912472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:36.914941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=85 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:37.038625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:37.047066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:37.048496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:37.049643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5a1c2191-2074-4602-9ce3-866dd27fd9e2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151152 Oct 15 08:48:37.050244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 254/505] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:36 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:38.073824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:38.074425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:38.080326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:38.080801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:38.081225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:38.081927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:38.082373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:38.082787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:38.209158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:38.219300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:38.220877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:38.222077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-338b7c4a-31e8-410c-8f2f-6536b52bcf69 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152305 Oct 15 08:48:38.222698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 252/506] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:39.248446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:39.249037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:39.255406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:39.255874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:39.256295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:39.256966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:39.257415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:39.257865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:39.382103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:39.391967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:39.393390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:39.398542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9ced1681-ea18-43be-bc17-1ab9e42739b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150048 Oct 15 08:48:39.398542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 255/507] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:40.421644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:40.422283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:40.428663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:40.429140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:40.429567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:40.430276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:40.430723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:40.431145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:40.558606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:40.567249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:40.568675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:40.569840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-eba587d7-e039-4c27-9914-0cc5b2f00248 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152877 Oct 15 08:48:40.570410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 253/508] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:41.595594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:41.596191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:41.602468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:41.602944 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:41.603368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:41.604044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:41.604492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:41.604909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:41.730867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:41.739927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:41.741340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:41.742510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-74866455-0f17-42ed-b342-ef4bd0301c8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150834 Oct 15 08:48:41.743053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 256/509] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:42.768249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:42.768851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:42.775315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:42.775736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:42.776168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:42.776841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:42.777291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:42.777991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:42.901596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:42.910433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:42.912189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:42.913393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1302e9cf-415d-4484-9dc4-b11bf20bdafa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148945 Oct 15 08:48:42.913987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 254/510] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:43.939636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:43.940239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:43.946771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:43.947251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:43.947687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:43.948365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:43.948817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:43.949241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:44.072208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:44.081275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:44.082745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:44.083888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8202b5c2-8c83-4eb5-8335-26b2d7faec09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148121 Oct 15 08:48:44.084435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 257/511] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:45.109011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:45.109614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:45.116235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:45.116708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:45.117134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:45.117846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:45.118290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:45.118705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:45.248632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:45.257210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:45.258768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:45.259918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-487a35ea-8220-479e-80bb-12d28c94cf7b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154887 Oct 15 08:48:45.260501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 255/512] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:46.286528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:46.287071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:46.294693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:46.295179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:46.295602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:46.296492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:46.296942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:46.297356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:46.427771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:46.436279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:46.437730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:46.438876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2fa8fc60-323c-4a22-a554-04a91bd48271 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156222 Oct 15 08:48:46.439423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 258/513] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:47.463282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:47.463911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:47.471002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:47.471474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:47.471898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:47.472577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:47.473020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:47.473433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:47.599076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:47.607492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:47.608911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:47.610072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e0885fea-83ee-47f4-82c3-29b6ba1886d5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150599 Oct 15 08:48:47.610617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 256/514] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:48.634789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:48.635397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:48.641726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:48.642202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:48.642628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:48.643303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:48.643749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:48.644166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:48.770661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:48.779959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:48.781390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:48.782566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5b617aac-f403-424d-9870-1e61721e0c39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151590 Oct 15 08:48:48.783112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 259/515] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:49.807573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:49.808178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:49.815315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:49.815793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:49.816225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:49.816907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:49.817357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:49.817805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:49.942619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:49.951071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:49.952646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:49.953827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0528cf73-3d0b-40d9-af79-dd82acd86e45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150088 Oct 15 08:48:49.954381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 257/516] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:50.979872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:50.980525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:50.987022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:50.987493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:50.987920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:50.988592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:50.989038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:50.989454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:51.120664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:51.129515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:51.130974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:51.132118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-46c26df2-2d85-4ace-ae40-bf15c1c41cd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156150 Oct 15 08:48:51.132664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 260/517] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:52.158273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:52.158879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:52.165181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:52.165659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:52.166124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:52.166803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:52.167252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:52.167673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:52.292274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:52.301381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:52.302850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:52.303990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aa3125bc-6153-43f4-a2be-cb4549991344 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150174 Oct 15 08:48:52.304543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 258/518] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:53.328858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:53.329400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:53.335801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:53.336276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:53.336707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:53.337384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:53.338034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:53.338461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:53.464837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:53.474217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:53.475680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:53.476825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7d7385ce-2329-4404-946e-32d49c8701c1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152443 Oct 15 08:48:53.477366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 261/519] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:54.502584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:54.503193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:54.509699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:54.510184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:54.510613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:54.511293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:54.511745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:54.512196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:54.634816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:54.643806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:54.645279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:54.646467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e3503f2-ac70-4fb1-890d-728b86f1f38c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147751 Oct 15 08:48:54.647017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 259/520] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:55.670960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:55.671591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:55.678178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:55.678655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:55.679087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:55.679769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:55.680218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:55.680638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:55.817570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:55.826869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:55.828303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:55.829446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e5703e81-2d5a-4a29-8516-f930120c9369 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.162367 Oct 15 08:48:55.832979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 262/521] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:56.855209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:56.855820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:56.863187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:56.863489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:56.863960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:56.864588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:56.865043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:56.865464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:56.868281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:48:56.997887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:57.006373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:57.007829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:57.008959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b1c01253-503b-4ecc-bb2e-ff6f526ccc96 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.157562 Oct 15 08:48:57.009506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 260/522] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:56 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:58.034751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:58.035355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:58.041838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:58.042316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:58.042744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:58.043424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:58.043873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:58.044804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:58.168995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:58.178155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:58.179592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:58.180734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ade1d968-0cff-432f-a18d-25deaef32d25 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149792 Oct 15 08:48:58.181276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 263/523] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:48:59.206463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:48:59.207077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:48:59.213406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:59.213919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:59.214351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:59.215070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:48:59.215519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:48:59.215941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:48:59.343368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:59.351808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:59.353237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:48:59.354414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d989c9d9-94c5-4dad-b5be-2231aff6cbdc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151846 Oct 15 08:48:59.354969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 261/524] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:48:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:00.380067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:00.380668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:00.387103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:00.387583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:00.388012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:00.388696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:00.389146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:00.389567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:00.517939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:00.526369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:00.528058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:00.529778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cf0afe1d-10bc-4e97-b849-191777df5650 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153631 Oct 15 08:49:00.530328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 264/525] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:01.554734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:01.555340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:01.557633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=28 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:01.563040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:01.563525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:01.563965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:01.564661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:01.565116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:01.565539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:01.694963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:01.703998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:01.705435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:01.706631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3745e6a4-68a9-4997-94d9-edfaf62d7f09 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155743 Oct 15 08:49:01.707188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 262/526] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:02.732740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:02.733270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:02.739605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:02.740079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:02.740507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:02.741180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:02.741627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:02.742070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:02.868909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:02.877987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:02.879411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:02.880553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-900738f5-a72f-4547-bce6-de29634c71cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151899 Oct 15 08:49:02.881095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 265/527] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:03.907485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:03.908187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:03.914485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:03.914972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:03.915405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:03.916093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:03.916548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:03.916972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:04.040482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:04.049514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:04.050999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:04.052189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d4d845a6-faf1-4f8f-a470-690b9360aa2d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149534 Oct 15 08:49:04.052747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 263/528] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:05.078698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:05.079301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:05.081597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:05.087138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:05.087618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:05.088052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:05.088734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:05.089189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:05.089613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:05.218044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:05.226546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:05.227979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:05.229112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-514e3a4a-9235-416f-8b83-0d6f227cc4d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154941 Oct 15 08:49:05.229651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 266/529] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:06.258540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:06.259142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:06.266157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:06.266657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:06.267174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:06.267757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:06.268199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:06.268614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:06.398902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:06.408466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:06.409924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:06.411098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-de79c7a6-85e0-4ec3-8d56-c8ac93624914 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156447 Oct 15 08:49:06.411644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 264/530] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:07.436449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:07.437106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:07.443217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:07.445152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:07.445588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:07.446307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:07.446758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:07.447188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:07.449864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:07.577798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:07.586305 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:07.587740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:07.588887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-12d8e7b0-f6ea-424a-bb15-4ba9e76416ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156591 Oct 15 08:49:07.589430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 267/531] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:08.614502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:08.615111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:08.620929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:08.621406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:08.621884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:08.622564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:08.623017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:08.624036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:08.747224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:08.755723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:08.757155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:08.758336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-306e9baa-012e-4f33-9b2c-d3f9546dd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147828 Oct 15 08:49:08.758885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 265/532] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:09.784301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:09.784901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:09.791379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:09.791858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:09.792289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:09.792972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:09.793423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:09.793879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:09.918807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:09.928184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:09.929649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:09.931012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e6cb9669-d6fc-431b-ab26-b203a8b95a5f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150548 Oct 15 08:49:09.931551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 268/533] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:09 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:10.957004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:10.957617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:10.964186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:10.964666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:10.965095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:10.965807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:10.966258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:10.967272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:11.095945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:11.104616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:11.106081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:11.107281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-09eda117-8897-41e4-977f-c348d5658d91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154127 Oct 15 08:49:11.108448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 266/534] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:10 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:12.134422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:12.135021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:12.141352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:12.141861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:12.142292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:12.142968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:12.143412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:12.143829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:12.267203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:12.275699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:12.277119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:12.278550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cd11cd2d-93f5-4853-9ebf-1ada2355228c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147706 Oct 15 08:49:12.279091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 269/535] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:13.304333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:13.304943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:13.311949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:13.312424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:13.312855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:13.313542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:13.314026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:13.314448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:13.442037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:13.450468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:13.452503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:13.453706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a4f630e3-78be-4ae0-9731-c73e9dbc258f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153270 Oct 15 08:49:13.454263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 267/536] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:14.478419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:14.479024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:14.485485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:14.485987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:14.486414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:14.487089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:14.487535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:14.487951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:14.611702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:14.620079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:14.621485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:14.622670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ccc198db-603d-4771-9d51-d4ba61a469e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148168 Oct 15 08:49:14.623731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 270/537] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:15.648398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:15.649011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:15.656250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:15.656685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:15.657120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:15.657839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:15.658298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:15.658726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:15.782005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:15.790385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:15.791801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:15.792937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cd4cbe79-3c1e-413d-b587-801803de093b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148474 Oct 15 08:49:15.793488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 268/538] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:15 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:16.818718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:16.819321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:16.825749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:16.826271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:16.826747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:16.827427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:16.827879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:16.828303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:16.962921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:16.971934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:16.973372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:16.974567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-08ea944f-0834-403a-8732-22104f968001 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.159731 Oct 15 08:49:16.975288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 271/539] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:18.000873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:18.001581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:18.008243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:18.008726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:18.009154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:18.009865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:18.010316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:18.010722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:18.137710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:18.146156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:18.147601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:18.148759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b9752ac5-efb6-4df7-a5d9-57c56a7f2b08 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152352 Oct 15 08:49:18.149310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 269/540] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:19.177002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:19.177566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:19.184064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:19.184543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:19.184975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:19.185767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:19.186243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:19.186662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:19.313886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:19.322319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:19.323735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:19.324869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-48204b03-2105-44b9-a145-32e7b0cb2f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151804 Oct 15 08:49:19.325413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 272/541] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:20.350792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:20.351444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:20.358277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:20.358762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:20.359193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:20.359877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:20.360331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:20.360758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:20.487235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:20.495748 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:20.497182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:20.499009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fd14f102-0bb2-4161-9023-ed6e76e2a1e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152054 Oct 15 08:49:20.499563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 270/542] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:21.524263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:21.524890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:21.531520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:21.531997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:21.532461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:21.533141 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:21.533597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:21.534044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:21.660624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:21.669214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:21.670815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:21.672157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-24d44627-af25-4dd5-ae64-96eb7c238783 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151809 Oct 15 08:49:21.672767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 273/543] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:22.697989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:22.698566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:22.705438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:22.705954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:22.706388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:22.707076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:22.707537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:22.707960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:22.829995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:22.838415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:22.839844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:22.840988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-40b80226-0236-40f6-a358-a6ab184d9587 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147017 Oct 15 08:49:22.842170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 271/544] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:22 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:23.866718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:23.867328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:23.873763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:23.874252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:23.874691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:23.875380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:23.875837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:23.876258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:23.999608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:24.008094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:24.009531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:24.010708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c2aec703-12c4-42c5-bc97-1bdb3b01ef39 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147892 Oct 15 08:49:24.011255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 274/545] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:25.036323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:25.036933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:25.043334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:25.043819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:25.044255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:25.045268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:25.045994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:25.046658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:25.173225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:25.182133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:25.183575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:25.184727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bbf8e1f3-b5ac-40aa-9533-4aef2a966255 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152330 Oct 15 08:49:25.185837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 272/546] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:26.210658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:26.211269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:26.218185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:26.218669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:26.219104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:26.219788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:26.220241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:26.220661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:26.398542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:26.408331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:26.409791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:26.410932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c2e3bb09-57a9-4a2f-ba94-6b17c40f396c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.204174 Oct 15 08:49:26.411483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 275/547] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:27.436432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:27.437037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:27.443935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:27.444411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:27.444852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:27.445520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:27.445990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:27.446408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:27.450329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:27.634303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:27.643654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:27.645078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:27.646257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-90baaee2-64c4-4f8b-b9ee-4f95be8d7908 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.213853 Oct 15 08:49:27.646801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 273/548] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:28.671960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:28.672590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:28.679044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:28.679521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:28.679950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:28.680632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:28.681079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:28.681500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:28.809481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:28.818312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:28.819742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:28.820890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c85b617d-45a7-4827-9d21-e30baaae52cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152872 Oct 15 08:49:28.821472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 276/549] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:29.847102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:29.847737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:29.854121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:29.854595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:29.855017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:29.855691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:29.856138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:29.856554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:29.984073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:29.992872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:29.994366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:29.995545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6a93dbd9-c95f-4fb9-a900-2954b07ae802 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152435 Oct 15 08:49:29.996099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 274/550] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:49:31.021558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:31.022181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:31.028798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:31.029269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:31.030505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:31.031186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:31.031636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:31.032051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:31.160904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:31.169355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:31.171350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:31.172480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9aa28ce1-b2a0-4bc9-94d5-bfc64bfdb644 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154701 Oct 15 08:49:31.173017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 277/551] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:32.197596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:32.198147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:32.200405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:32.206522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:32.207025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:32.207451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:32.208125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:32.208568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:32.208984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:32.332817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:32.341270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:32.342736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:32.343891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4eee96f7-6d2b-484e-aa13-fe064c54a97f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150273 Oct 15 08:49:32.344444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 275/552] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:33.369912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:33.370453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:33.377351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:33.377879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:33.378312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:33.378996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:33.379449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:33.379874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:33.507716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:33.516749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:33.518204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:33.519341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d157f66a-5888-4fce-97d7-64820f9bd181 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153497 Oct 15 08:49:33.519894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 278/553] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:34.544028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:34.544640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:34.551561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:34.552041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:34.552464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:34.553141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:34.553587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:34.554027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:34.678740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:34.687655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:34.689065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:34.690235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9cac6e6c-48db-4469-aef5-3ffb1cf1d139 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150161 Oct 15 08:49:34.690781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 276/554] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:35.716619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:35.717248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:35.719935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:35.725660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:35.726162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:35.726598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:35.727288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:35.727743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:35.728168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:35.854479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:35.862998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:35.864420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:35.865550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9ac6510f-f7b0-45e8-bf79-92f2da96a969 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152869 Oct 15 08:49:35.866127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 279/555] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:36.892032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:36.892649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:36.899304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:36.899790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:36.900221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:36.900915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:36.901369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:36.901823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:37.032262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:37.041477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:37.042966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:37.044128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3f2103df-93f5-46bc-b91f-a6323c993519 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156600 Oct 15 08:49:37.057701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 277/556] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:36 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:38.072600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:38.074658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:38.080786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:38.081274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:38.081739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:38.082419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:38.082869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:38.083291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:38.087470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:38.216508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:38.225729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:38.227160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:38.228314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1906c4e0-6b54-41ff-838a-9448a14b3d8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.161443 Oct 15 08:49:38.229051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 280/557] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:39.255244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:39.255849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:39.262387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:39.262859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:39.263285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:39.264016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:39.264499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:39.264923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:39.390673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:39.399421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:39.400822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:39.401999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-58f372f4-6181-4cd7-94df-081870809773 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150572 Oct 15 08:49:39.402560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 278/558] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:40.428731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:40.429341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:40.436248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:40.436720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:40.437155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:40.437866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:40.438315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:40.438741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:40.566943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:40.575791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:40.577391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:40.578582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-696e41dc-67cf-4ec0-a85d-63a4d2f5efd3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153774 Oct 15 08:49:40.579130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 281/559] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:41.604424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:41.605064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:41.611548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:41.612055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:41.612488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:41.613170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:41.613620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:41.614075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:41.771824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:41.780900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:41.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:41.783515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2874a219-1d32-4d99-a80a-5e54bd024abb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.183606 Oct 15 08:49:41.784074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 279/560] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:42.809217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:42.809848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:42.816222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:42.816695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:42.817123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:42.817824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:42.818271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:42.818686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:42.944099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:42.953631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:42.955159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:42.956306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-15d59348-67d5-4274-90ba-de8b06d80dba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150957 Oct 15 08:49:42.956905 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 282/561] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:43.987411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:43.987956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:43.994339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:43.994822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:43.995258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:43.995943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:43.996396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:43.996854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:44.125074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:44.133590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:44.135042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:44.136192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e26711aa-fdee-4051-9f83-03d159a93824 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152785 Oct 15 08:49:44.136747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 280/562] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:45.193498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:49:45.193985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:49:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:49:45.263260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:45.264697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:45.274191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:45.274668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:45.275104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:45.275788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:45.276238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:45.276657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:45.401015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:45.410495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:45.411934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:45.413113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-570cb9fa-e671-43f0-b021-5aaafb3a2c05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.254235 Oct 15 08:49:45.413707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 283/563] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:46.438984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:46.439590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:46.442615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:49:46.442759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 08:49:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:49:46.449305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:46.449808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:46.450239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:46.451011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:46.452071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:46.452490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:46.581462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:46.590144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:46.591601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:46.592777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5922c3c6-18a8-499f-ae0f-7c4b0a59b6f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.158292 Oct 15 08:49:46.593314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 281/564] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:47.618882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:47.619519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:47.626436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:47.626914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:47.627365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:47.628049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:47.628655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:47.628907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:47.757753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:47.767107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:47.768615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:47.769794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c705736c-d7c6-4110-9c45-7fbc1f7b928a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154780 Oct 15 08:49:47.770339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 284/565] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:48.795591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:48.796361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:48.802894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:48.803378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:48.803822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:48.804509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:48.804969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:48.805389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:48.932540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:48.940937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:48.942399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:48.943558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-529f2d75-8488-46ae-a349-4b55aa72f404 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151901 Oct 15 08:49:48.944104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 282/566] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:49.969694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:49.970311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:49.976712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:49.977190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:49.977625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:49.978341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:49.978799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:49.979222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:50.107882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:50.116380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:50.117847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:50.119010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-707463bc-48cb-4790-ba48-73b04e3be81d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153978 Oct 15 08:49:50.119732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 285/567] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:51.144352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:51.144975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:51.151381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:51.151857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:51.152286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:51.152966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:51.153416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:51.154178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:51.279805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:51.288320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:51.289783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:51.290948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-26e69c09-fb96-4b7d-92d3-d44305599e94 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150554 Oct 15 08:49:51.291499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 283/568] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:52.316691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:52.317303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:52.323671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:52.324155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:52.324594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:52.325288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:52.325769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:52.326199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:52.454566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:52.463154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:52.464595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:52.465776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7556f042-6ee5-4368-8038-0cf38ab57dd1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152937 Oct 15 08:49:52.466333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 286/569] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:53.492409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:53.493023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:53.500290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:53.500775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:53.501214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:53.501959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:53.502414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:53.502837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:53.626564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:53.634981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:53.636422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:53.637565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb531b85-9bc0-4205-9053-a77c7ad6de6e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149117 Oct 15 08:49:53.638137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 284/570] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:54.663628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:54.664232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:54.670741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:54.671216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:54.671646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:54.672329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:54.672780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:54.673199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:54.798134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:54.806656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:54.808085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:54.809229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-261437f6-ee4e-4038-8501-d2fbfa7fb371 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149522 Oct 15 08:49:54.809798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 287/571] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:55.834906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:55.835522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:55.842496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:55.842969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:55.843395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:55.844070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:55.844520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:55.844940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:55.970204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:55.978615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:55.980057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:55.981200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5e3a82a7-19b9-45c4-b278-34eee46fe661 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150227 Oct 15 08:49:55.981771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 285/572] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:57.007233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:57.007834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:57.014757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:57.015228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:57.015652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:57.016324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:57.016770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:57.017184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:57.145962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:57.155086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:57.156539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:57.157988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d919ffba-9648-4da1-a8b6-642c49012adc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154653 Oct 15 08:49:57.158617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 288/573] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:58.184292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:58.184900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:58.191847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:58.192202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:58.192625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:58.193311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:58.193787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:58.194215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:58.196763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:49:58.337280 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:58.345779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:58.347195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:58.348333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-593d157d-46c7-4552-af94-dcae7dd13629 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.168254 Oct 15 08:49:58.348880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 286/574] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:49:59.373770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:49:59.374472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:49:59.380782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:59.381255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:59.381709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:59.382386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:49:59.382834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:49:59.383251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:49:59.507579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:59.516929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:59.518417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:49:59.519570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6f1cee0a-48b7-447f-a440-949d205ac668 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149747 Oct 15 08:49:59.520115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 289/575] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:49:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:00.545804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:00.546320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:00.552704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:00.553183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:00.553613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:00.554323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:00.554775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:00.555218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:00.685827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:00.694338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:00.695771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:00.696933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bfdb6d8f-c075-4644-b8af-c3b2dbb29b0e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155062 Oct 15 08:50:00.697491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 287/576] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:01.723081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:01.723683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:01.726148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:50:01.726315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:50:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:50:01.733338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:01.733873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:01.734317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:01.735011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:01.735466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:01.735892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:01.859368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:01.867846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:01.869294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:01.870479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e80e55b2-69de-4186-9b93-0f25a4b97f6d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151427 Oct 15 08:50:01.871031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 290/577] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:02.896626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:02.897254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:02.899562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:02.905597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:02.906101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:02.906531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:02.907211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:02.907657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:02.908098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:03.035704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:03.044206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:03.046268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:03.047426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc134026-640a-408d-9658-e2cbfe990fca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154745 Oct 15 08:50:03.047984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 288/578] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:04.077857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:04.078390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:04.084707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:04.085213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:04.085645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:04.086355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:04.086810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:04.087234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:04.215896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:04.224482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:04.225952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:04.227133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d35aeeb8-e8bc-4258-8450-85308b2ecf07 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153804 Oct 15 08:50:04.227678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 291/579] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:04 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:05.252657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:05.253268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:05.260192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:05.260671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:05.261095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:05.261799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:05.262250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:05.262673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:05.387165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:05.395747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:05.397167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:05.398345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dfa1ac91-afb1-4ea8-a107-03ee5e0fa823 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149572 Oct 15 08:50:05.398892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 289/580] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:06.427998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:06.428602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:06.430723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:06.436412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:06.436886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:06.437315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:06.438021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:06.438473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:06.438893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:06.564359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:06.572917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:06.574394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:06.575518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-173c8418-fbf6-4ee4-9039-c01a07acbf7a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151431 Oct 15 08:50:06.576659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 292/581] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:07.601853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:07.602456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:07.608515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:07.608988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:07.609414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:07.610140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:07.610589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:07.611004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:07.737526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:07.746119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:07.747554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:07.748703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-19a7e846-8ccd-41dd-973d-a4766e46dd24 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150824 Oct 15 08:50:07.749250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 290/582] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:08.775358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:08.775977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:08.783169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:08.783656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:08.784085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:08.784772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:08.785222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:08.785641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:08.789603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:08.909876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:08.918406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:08.920429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:08.921572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-af7a665a-6946-47a5-9b78-755985383865 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151150 Oct 15 08:50:08.922161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 293/583] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:09.947006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:09.947615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:09.954468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:09.954944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:09.955375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:09.956055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:09.956506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:09.956926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:10.085610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:10.094938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:10.096386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:10.097550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-57bdbfd9-5a0a-4e5c-91b1-35864cc6f9dd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154354 Oct 15 08:50:10.098143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 291/584] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:09 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:11.125216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:11.125774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:11.132093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:11.132566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:11.132992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:11.133666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:11.134133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:11.134547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:11.271003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:11.280059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:11.281514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:11.282707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ff58b220-725b-46d7-89b9-7029f043f084 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.162019 Oct 15 08:50:11.283258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 294/585] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:12.308819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:12.309427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:12.316330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:12.316804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:12.317237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:12.317940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:12.318390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:12.318808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:12.447808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:12.456343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:12.457818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:12.458972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-049fbceb-0be0-4b09-b08e-e13f39f0cfc4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153961 Oct 15 08:50:12.459524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 292/586] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:13.486570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:13.487197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:13.493596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:13.494102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:13.494532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:13.495203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:13.495645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:13.496060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:13.619472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:13.628063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:13.629478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:13.630647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3ba75a2-0122-46f4-9e54-80f5d808bd84 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148653 Oct 15 08:50:13.631196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 295/587] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:14.658776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:14.659320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:14.665730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:14.666209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:14.666639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:14.667320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:14.667770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:14.668195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:14.796135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:14.804637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:14.806118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:14.807274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-633f0010-0b11-40b7-8371-f02e9aca2314 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153359 Oct 15 08:50:14.812652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 293/588] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:50:15.833117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:15.833769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:15.840278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:15.840731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:15.841870 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:15.842576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:15.843030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:15.843537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:15.966701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:15.975067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:15.976478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:15.977615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-130af431-f0de-402a-a374-3bfc1992310a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148370 Oct 15 08:50:15.978185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 296/589] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:15 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:17.002967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:17.003569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:17.010001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:17.010473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:17.010899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:17.011572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:17.012017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:17.012434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:17.139767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:17.148245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:17.149687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:17.150856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a417b610-17fb-4d44-b6e6-85ccd7a912b1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151781 Oct 15 08:50:17.151621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 294/590] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:18.176259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:18.177121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:18.183498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:18.183966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:18.184393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:18.185149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:18.185535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:18.185981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:18.330638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:18.339084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:18.340497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:18.342285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7242b35d-e7fb-49f2-b9a2-86185f54daf6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.169956 Oct 15 08:50:18.342832 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 297/591] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:19.367129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:19.367735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:19.374592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:19.375072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:19.375505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:19.376183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:19.376633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:19.377061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:19.502118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:19.510553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:19.511998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:19.513660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-32b9ab41-f6ce-47c8-9f0a-f1384492b0fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149799 Oct 15 08:50:19.514233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 295/592] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:20.539940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:20.540469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:20.547455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:20.547931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:20.548362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:20.549045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:20.549494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:20.549954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:20.677233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:20.686201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:20.687619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:20.688791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8f1f2251-e00f-4a98-b178-6e7407c81376 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152866 Oct 15 08:50:20.689338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 298/593] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:21.714003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:21.714519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:21.721364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:21.721962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:21.722399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:21.723114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:21.723567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:21.724072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:21.852212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:21.860779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:21.862228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:21.863371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e29c9f90-1992-40c4-8b6a-7d2de3ef5806 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153373 Oct 15 08:50:21.863913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 296/594] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:50:22.888482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:22.889078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:22.895537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:22.896009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:22.896436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:22.897106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:22.897554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:22.898000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:23.021860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:23.031517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:23.033066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:23.034387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c9cd059e-2dbf-4ae5-997c-6c47b0c4656a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149862 Oct 15 08:50:23.034994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 299/595] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:22 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:24.060865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:24.061465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:24.067819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:24.068293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:24.068719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:24.069392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:24.069877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:24.070291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:24.197112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:24.205672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:24.207138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:24.208287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c80590f5-4a7e-4493-829e-77f0b4b3a673 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151932 Oct 15 08:50:24.208845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 297/596] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:25.233995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:25.234526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:25.240865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:25.241336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:25.241784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:25.242552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:25.242998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:25.243414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:25.371922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:25.380866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:25.382309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:25.383455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3e289d23-3605-4abf-8682-1e870e768cad tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153502 Oct 15 08:50:25.384007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 300/597] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:26.409157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:26.409777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:26.416144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:26.416624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:26.417053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:26.417763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:26.418213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:26.418635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:26.545620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:26.554192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:26.555623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:26.556767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b86592e9-fb4d-4d7d-bbc7-e66c0f0c3aa7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151506 Oct 15 08:50:26.557326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 298/598] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:27.582463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:27.583063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:27.589419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:27.589936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:27.590365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:27.591115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:27.591590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:27.592010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:27.720031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:27.728657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:27.730134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:27.731295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-da8ec33e-28ad-48cb-8266-d3a90860a8a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152701 Oct 15 08:50:27.733872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 301/599] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:28.757662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:28.758200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:28.765248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:28.765745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:28.766182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:28.766865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:28.767312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:28.767725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:28.770275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:28.898180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:28.907154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:28.908568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:28.909739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-05d7ae2b-a5bc-44d8-91ab-e494a38f14c6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156021 Oct 15 08:50:28.910288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 299/600] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:29.939670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:29.940299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:29.946547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:29.947028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:29.947459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:29.948140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:29.948592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:29.949013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:30.077120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:30.085797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:30.087237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:30.088383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b3d9988d-1a50-4542-98ed-ece12e01fb1c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153024 Oct 15 08:50:30.088933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 302/601] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:31.114229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:31.114757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:31.121043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:31.121515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:31.121982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:31.122659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:31.123142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:31.123561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:31.248867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:31.257225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:31.258670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:31.259810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b3081cb6-d858-4441-92a1-9dfe0c7480ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149520 Oct 15 08:50:31.260426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 300/602] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:32.286220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:32.286819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:32.293144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:32.293621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:32.294082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:32.294765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:32.295738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:32.296158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:32.437191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:32.445660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:32.447113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:32.448262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e090c05c-334c-43f9-ae91-d4d90037614c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.165943 Oct 15 08:50:32.448811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 303/603] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:33.473690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:33.474658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:33.477182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:33.483003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:33.483497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:33.483932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:33.484619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:33.485070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:33.485487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:33.609983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:33.618446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:33.619877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:33.621023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-07810e43-db74-4924-801b-393fa589bc83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151166 Oct 15 08:50:33.621569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 301/604] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:34.645643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:34.646285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:34.652699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:34.653126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:34.653558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:34.654868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:34.655335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:34.655756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:34.783104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:34.791598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:34.793026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:34.794207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1613bf12-66c5-4f9b-89ea-bb2a40b6b383 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152514 Oct 15 08:50:34.794756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 304/605] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:35.819406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:35.820010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:35.826488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:35.827002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:35.827427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:35.828098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:35.828540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:35.828956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:35.952658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:35.961173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:35.962642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:35.963791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5efc1f18-4913-40ae-bf62-e16537ac41c4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148260 Oct 15 08:50:35.964359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 302/606] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:50:36.989466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:36.990144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:36.992144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:36.997416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:36.998516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:36.998989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:36.999705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:37.000147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:37.000562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:37.130012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:37.138418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:37.139957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:37.141099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-743dbf5d-20e7-48b3-9610-42f25fd4b829 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155530 Oct 15 08:50:37.141638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 305/607] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:36 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:38.168085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:38.168691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:38.174926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:38.175489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:38.175859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:38.176542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:38.177015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:38.177431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:38.318775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:38.327949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:38.329470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:38.330742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-25a36538-8de6-43ff-98c9-975f6ff270ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.166448 Oct 15 08:50:38.331364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 303/608] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:39.356147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:39.356853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:39.363301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:39.363775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:39.364203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:39.364880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:39.365312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:39.365749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:39.370479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:39.494168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:39.502672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:39.504097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:39.505234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-64c8bec5-fbaa-4b42-837d-57868361ec8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152939 Oct 15 08:50:39.505800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 306/609] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:40.531301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:40.531869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:40.538349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:40.538828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:40.539260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:40.539951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:40.540403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:40.540850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:40.668086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:40.676521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:40.677983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:40.679160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-45b87b67-088a-4eb4-87a1-3e69394a3431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152726 Oct 15 08:50:40.679713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 304/610] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:41.704371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:41.704886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:41.711257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:41.711728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:41.712153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:41.712825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:41.713270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:41.713702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:41.839887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:41.849151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:41.850607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:41.851830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-27fa104b-b382-4819-be27-1c646c828c7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151350 Oct 15 08:50:41.852535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 307/611] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:42.877869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:42.878484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:42.884755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:42.885238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:42.885672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:42.886381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:42.886832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:42.887251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:43.019971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:43.028348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:43.030089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:43.031226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-018b00dd-a226-4a78-b52a-94c3e33c76e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.157280 Oct 15 08:50:43.031777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 305/612] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:44.057333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:44.057982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:44.065039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:44.065518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:44.065993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:44.066685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:44.067138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:44.067561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:44.287073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:44.296242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:44.297694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:44.298928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d47d4be4-dc29-4a9c-8099-e5f0742857a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.245485 Oct 15 08:50:44.299479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 308/613] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:45.324984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:45.325628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:45.331943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:45.332419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:45.332852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:45.333523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:45.334001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:45.334425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:45.464511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:45.473658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:45.475087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:45.476217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca1a57b2-fdd5-4101-82c8-27ffe9ff0bda tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155142 Oct 15 08:50:45.476772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 306/614] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:46.501993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:46.502601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:46.508899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:46.509367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:46.509834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:46.510506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:46.510976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:46.511390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:46.639538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:46.649782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:46.651259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:46.652351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-effa794c-138d-4255-88df-57a0ffcf8fab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154219 Oct 15 08:50:46.652890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 309/615] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:47.680079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:47.680700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:47.687116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:47.687599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:47.688033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:47.688719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:47.689168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:47.689608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:47.819979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:47.828464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:47.829918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:47.831069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dfb2ac4a-225e-4c55-a368-8c25d97a00b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154797 Oct 15 08:50:47.831613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 307/616] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:48.856138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:48.856738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:48.863563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:48.864038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:48.864463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:48.865137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:48.865580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:48.866019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:48.990365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:48.998876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:49.000327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:49.001462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d4e8041a-dee5-4443-bb49-a8ab8b42b760 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149208 Oct 15 08:50:49.002052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 310/617] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:50.027148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:50.027710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:50.034993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:50.035472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:50.035897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:50.036574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:50.037020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:50.037439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:50.160674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:50.169495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:50.170937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:50.172672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-588426e5-058b-4850-b2a8-91ce0aef1ac7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149473 Oct 15 08:50:50.173228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 308/618] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:51.197480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:51.198029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:51.204923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:51.205400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:51.205867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:51.206551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:51.207006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:51.207426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:51.334453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:51.342830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:51.344405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:51.345550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-92096f7e-ba4a-4138-b707-77048085d69b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152028 Oct 15 08:50:51.346140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 311/619] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:52.370542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:52.371138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:52.378274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:52.378745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:52.379172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:52.379845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:52.380298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:52.380711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:52.523347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:52.532746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:52.534229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:52.535380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6d3ef270-a178-45c6-a69f-ba53eec6f655 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.168700 Oct 15 08:50:52.535964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 309/620] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:53.560656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:53.561195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:53.568461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:53.568935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:53.569365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:53.570082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:53.570534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:53.570955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:53.698642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:53.707706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:53.709138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:53.710317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ccc990a0-966e-48ec-9ad4-54adb8eaad51 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153627 Oct 15 08:50:53.710896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 312/621] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:54.736243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:54.736780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:54.743129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:54.743598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:54.744022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:54.744700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:54.745144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:54.745559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:54.874183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:54.882685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:54.884108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:54.885249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-eba4e32d-3266-4dc9-b029-bc50939c651b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153008 Oct 15 08:50:54.885828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 310/622] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:55.911471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:55.912073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:55.918512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:55.918985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:55.919415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:55.920093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:55.920541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:55.921556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:56.053850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:56.062304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:56.063730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:56.064888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-567f7308-5b87-44e4-830b-a50c7b7df0a9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.157246 Oct 15 08:50:56.065424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 313/623] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:57.092427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:57.093123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:57.099620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:57.100103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:57.100530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:57.101209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:57.101656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:57.102095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:57.243112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:57.253782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:57.256071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:57.257368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9c024ad5-7d4c-4544-80ee-c1a3e91b7b12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.169076 Oct 15 08:50:57.258052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 311/624] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:58.284036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:58.284731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:58.291209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:58.291690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:58.292126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:58.292817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:58.293278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:58.293747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:58.420036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:58.429289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:58.430692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:58.431837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-04e72a2b-a94f-41dd-afa2-ba62601936f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152491 Oct 15 08:50:58.432386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 314/625] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:50:59.457737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:50:59.458354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:50:59.464848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:59.465324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:59.465796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:59.466482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:50:59.466932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:50:59.467355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:50:59.470513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:50:59.597601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:59.606234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:59.607670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:50:59.608849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2e08457a-ea59-4458-af61-6060b7bdc069 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155027 Oct 15 08:50:59.609405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 312/626] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:50:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:00.634309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:00.634882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:00.641274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:00.641782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:00.642214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:00.642889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:00.643338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:00.643757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:00.767108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:00.775552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:00.777008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:00.778213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-22af19c0-b614-400d-b3d2-2f75741786b0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148029 Oct 15 08:51:00.778769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 315/627] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:01.803407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:01.804019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:01.810426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:01.810906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:01.811338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:01.812556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:01.813006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:01.813428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:01.939577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:01.949994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:01.951563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:01.953383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cd965a3a-a32b-4c58-8bdc-b4467417504e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153854 Oct 15 08:51:01.954167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 313/628] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:02.979198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:02.979830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:02.986854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:02.987336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:02.987769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:02.988456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:02.988912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:02.989356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:03.116611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:03.125813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:03.127251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:03.128407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f1616bd0-7150-44b1-933d-0f55ada6ae5c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153200 Oct 15 08:51:03.128965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 316/629] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:04.153465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:04.154124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:04.156904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:04.162220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:04.162710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:04.163146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:04.163850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:04.164305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:04.164728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:04.301626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:04.311191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:04.316091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:04.317265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a46373bf-4530-44a9-b8bb-1a31f55c1935 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.167642 Oct 15 08:51:04.317851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 314/630] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:04 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:05.345980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:05.346590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:05.353102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:05.353583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:05.354061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:05.354751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:05.355203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:05.355626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:05.482467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:05.491365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:05.492781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:05.493941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-67728291-a8e8-4d60-83fa-976963761406 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151878 Oct 15 08:51:05.494515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 317/631] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:06.519278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:06.519896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:06.526352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:06.526865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:06.527301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:06.527990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:06.528444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:06.528867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:06.655736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:06.665323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:06.666834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:06.668004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a2570121-ff20-4c11-8759-9beed44188ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153226 Oct 15 08:51:06.668601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 315/632] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:07.694967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:07.695596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:07.698861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:07.702800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:07.703279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:07.703705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:07.704385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:07.704827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:07.705243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:07.836272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:07.845334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:07.846769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:07.847905 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1823c9ea-f4f5-4d71-b8df-16ef7985b96b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156940 Oct 15 08:51:07.848659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 318/633] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:08.873857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:08.874489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:08.880325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:08.880797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:08.881224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:08.881930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:08.882378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:08.882795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:09.007266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:09.016338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:09.017771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:09.018910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-14e270c3-45c9-4bef-88ba-808955afbf7f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149111 Oct 15 08:51:09.019468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 316/634] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:10.044302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:10.044841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:10.051253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:10.051729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:10.052157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:10.052837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:10.053287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:10.053736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:10.056228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:10.178899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:10.187885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:10.189318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:10.190485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2ae5f2af-ce7b-445b-9a3f-0f13b69238cd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150171 Oct 15 08:51:10.191038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 319/635] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:10 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:11.216464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:11.216985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:11.224023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:11.224508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:11.224942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:11.225630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:11.226182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:11.226606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:11.354108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:11.362666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:11.364104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:11.365288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-38d44654-a783-43c7-a626-12873bfe82b6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152785 Oct 15 08:51:11.365879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 317/636] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:12.391213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:12.391740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:12.398199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:12.398676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:12.399106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:12.399791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:12.400241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:12.400662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:12.526449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:12.536565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:12.538145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:12.539547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2128d38c-1c92-4a45-80e8-19d52533e2d0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152287 Oct 15 08:51:12.549578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 320/637] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:13.566227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:13.566843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:13.573596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:13.574131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:13.574565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:13.575256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:13.575707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:13.576129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:13.706653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:13.715066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:13.716487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:13.717639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-41e27c60-9fe1-4e09-a4d3-902e6d4a8581 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155266 Oct 15 08:51:13.718273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 318/638] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:14.743588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:14.744224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:14.751136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:14.751616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:14.752050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:14.752734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:14.753187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:14.753613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:14.877911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:14.886401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:14.887848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:14.888969 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f139b17-d477-4fa8-88b2-a5bc0117e362 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149290 Oct 15 08:51:14.889513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 321/639] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:15.914299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:15.914852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:15.921311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:15.921810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:15.922239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:15.922911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:15.923358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:15.923769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:16.048915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:16.057343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:16.058807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:16.059953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0c8c804b-69d7-42e8-8bce-80f5c062bae1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149629 Oct 15 08:51:16.060494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 319/640] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:15 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:17.086467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:17.087073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:17.089154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:51:17.089283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:51:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:51:17.095965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:17.096443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:17.096874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:17.097553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:17.098031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:17.098456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:17.227624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:17.236571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:17.238018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:17.239178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5128f40e-4dbb-4713-a2ec-c22060b25187 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156604 Oct 15 08:51:17.239719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 322/641] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:18.264225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:18.264830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:18.273329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:18.273909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:18.274302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:18.274999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:18.275454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:18.276006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:18.399830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:18.408619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:18.410120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:18.411277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a9cb47c7-8fb9-425c-8533-83012d7f008a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.150909 Oct 15 08:51:18.411831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 320/642] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:19.435650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:19.436245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:19.442556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:19.443026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:19.443449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:19.444125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:19.444568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:19.444985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:19.573096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:19.582204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:19.583640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:19.584791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-608d30d0-ed84-4078-8800-0ee6a61253f8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.153003 Oct 15 08:51:19.585339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 323/643] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:20.610344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:20.610953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:20.617250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:20.617752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:20.618181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:20.618852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:20.619298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:20.619729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:20.742026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:20.751021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:20.752447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:20.753583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-df94cf4e-0644-4bbd-b763-add1f2952060 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147175 Oct 15 08:51:20.754157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 321/644] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:21.780077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:21.780960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:21.787510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:21.787994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:21.788423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:21.789114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:21.789565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:21.790023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:21.918703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:21.927694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:21.929135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:21.930342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b6e59709-dd58-4a8d-8b2b-362a1b187431 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.154382 Oct 15 08:51:21.930890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 324/645] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:22.956925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:22.957568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:22.964009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:22.964489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:22.964921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:22.965601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:22.966090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:22.966512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:23.089614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:23.098421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:23.099865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:23.101020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d39a84d-29f1-4dfa-a14f-0af8cce2dd91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148719 Oct 15 08:51:23.101568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 322/646] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:22 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:24.126952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:24.127561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:24.134000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:24.134481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:24.134912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:24.135596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:24.136048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:24.136472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:24.261139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:24.269615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:24.271089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:24.272244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1d89e3b7-b0f6-42d2-928d-b99901f31b5e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149749 Oct 15 08:51:24.272798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 325/647] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:25.298392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:25.299000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:25.305609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:25.306124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:25.306546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:25.307221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:25.307663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:25.308078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:25.435422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:25.443909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:25.445321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:25.446484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d71efd59-8354-4bfa-b2b6-bffd17082189 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152872 Oct 15 08:51:25.447033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 323/648] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:26.472355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:26.472958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:26.479744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:26.480217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:26.480645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:26.481336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:26.481817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:26.482245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:26.606084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:26.615410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:26.616837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:26.618011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-987383f4-f313-4265-9766-e6ec5e5cf2c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.149573 Oct 15 08:51:26.618558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 326/649] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:27.643913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:27.644538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:27.652372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:27.652852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:27.653275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:27.653990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:27.654439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:27.655064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:27.789288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:27.797866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:27.799322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:27.800536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6811b9c0-4d99-47de-86a2-742feda31903 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.160656 Oct 15 08:51:27.801091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 324/650] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:28.825579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:28.826215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:28.833309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:28.833824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:28.834259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:28.834940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:28.835392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:28.835814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:28.958224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:28.966730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:28.968385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:28.969829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-58e9d014-173d-49cd-92b1-66a80a1e9221 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148079 Oct 15 08:51:28.970379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 327/651] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:29.994944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:29.995576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:30.002144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:30.002624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:30.003057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:30.003742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:30.004190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:30.004652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:30.008955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:30.134978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:30.144104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:30.145534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:30.146713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1e1d5b51-79b1-47a5-8cce-577ecdc8adb8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155654 Oct 15 08:51:30.147279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 325/652] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:31.172350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:31.172955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:31.179308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:31.179786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:31.180218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:31.180899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:31.181355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:31.181805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:31.304391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:31.313418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:31.314884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:31.316029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ab32ce33-5b6e-44f8-a27d-ab8b351c5657 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.147525 Oct 15 08:51:31.316575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 328/653] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:32.342409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:32.343018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:32.350002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:32.350482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:32.350914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:32.351599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:32.352050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:32.352472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:32.476189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:32.484655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:32.486125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:32.487281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-723091a8-04e6-420b-a743-9d3641b452b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148854 Oct 15 08:51:32.487838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 326/654] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:33.513073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:33.513671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:33.520606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:33.521082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:33.521510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:33.522213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:33.522660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:33.523080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:33.649478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:33.658456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:33.659921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:33.661074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-707c300c-3662-403a-8634-13b4480fdac1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151889 Oct 15 08:51:33.661631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 329/655] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:34.686914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:34.687424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:34.689825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:34.695045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:34.695535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:34.695970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:34.696661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:34.697111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:34.697532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:34.822830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:34.831897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:34.833320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:34.834487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a3b4d8ed-fc11-4186-97b5-7bea8e13be89 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151573 Oct 15 08:51:34.835034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 327/656] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:35.859261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:35.859898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:35.866846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:35.867326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:35.867756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:35.868435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:35.868886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:35.869310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:36.245957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:36.254522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:36.255942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:36.257086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cfcb3c88-05ca-4a7b-8fbd-33b96da668fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.401641 Oct 15 08:51:36.257635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 330/657] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:37.282752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:37.283438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:37.289344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:37.289864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:37.290298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:37.290980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:37.291432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:37.291850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:37.414913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:37.423998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:37.425342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:37.426516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-710db867-1833-4c7d-9e3a-23a05398dfd8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148212 Oct 15 08:51:37.427069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 328/658] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:37 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:38.452247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:38.452869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:38.455207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:38.460522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:38.461023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:38.461449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:38.462148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:38.462588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:38.463003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:38.589840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:38.598783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:38.600231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:38.601367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8eff4ff3-4577-4394-a394-4c81f7e9752d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152993 Oct 15 08:51:38.601946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 331/659] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:39.627065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:39.627710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:39.634445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:39.634956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:39.635391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:39.636076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:39.636526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:39.636944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:39.764215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:39.773269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:39.774720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:39.775860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-70847fa8-ae0d-447e-ab03-07cc827fc5df tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.152812 Oct 15 08:51:39.776402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 329/660] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:40.802424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:40.803140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:40.809543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:40.810048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:40.810488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:40.811151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:40.811597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:40.812012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:40.815121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:51:40.935727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:40.944595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:40.946049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:40.947184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-82b136ba-ac62-4f0e-a77c-ed70bfb35667 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.148621 Oct 15 08:51:40.947729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 332/661] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:41.972860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:41.973413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:41.979917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:41.980399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:41.980834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:41.981552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:41.982032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:41.982458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:42.113576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:42.122123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:42.123591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:42.124745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc79c018-bb57-4b1e-a4a3-375b421190ba tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.156368 Oct 15 08:51:42.125300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 330/662] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:43.149782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:43.150385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:43.158109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:43.158612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:43.159042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:43.159725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:43.160169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:43.160591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:43.286580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:43.294992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:43.296464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:43.297601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-806fc3a1-cd00-42f0-95aa-acdf55b9149d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.151754 Oct 15 08:51:43.298838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 333/663] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:44.323417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:44.324102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:44.330629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:44.331114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:44.331545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:44.332246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:44.332682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:44.333104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:44.463701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:44.472691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:44.474143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:44.475297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8696a93-3306-4136-a64c-6b9afa6da174 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1753 microversion: 2.20 time: 0.155759 Oct 15 08:51:44.475851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 331/664] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:45.500341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:45.500951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:45.507370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:45.507852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:45.508289 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:45.508969 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:45.509425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:45.509884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:45.636895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:45.645731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:45.647164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:45.648311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cc8ce2b3-3652-4028-807b-b6a660d5806c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151850 Oct 15 08:51:45.648857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 334/665] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:46.674108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:46.674720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:46.676741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:51:46.676885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 08:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:51:46.684944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:46.685422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:46.686080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:46.686772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:46.687224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:46.687646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:46.815324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:46.823773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:46.825195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:46.826382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-760c5ce4-02bf-4453-a0d1-c50112df8347 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156326 Oct 15 08:51:46.826938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 332/666] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:47.852144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:47.852750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:47.859035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:47.859507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:47.859933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:47.861205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:47.861707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:47.862130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:47.987638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:47.996144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:47.997597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:47.998772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-95775239-64ab-4b7b-adb1-3c9b209ddf12 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150423 Oct 15 08:51:47.999322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 335/667] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:49.024051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:49.024749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:49.031398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:49.031873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:49.033058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:49.033782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:49.034236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:49.034652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:49.158732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:49.167216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:49.168721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:49.169897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4309cbe1-9784-441f-a019-331be54743ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149657 Oct 15 08:51:49.170445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 333/668] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:50.196135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:50.196747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:50.203105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:50.203590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:50.204052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:50.204737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:50.205192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:50.205616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:50.337280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:50.346357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:50.347813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:50.348948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84b89433-888f-4b3b-8acd-26a40476b2db tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156708 Oct 15 08:51:50.349491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 336/669] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:51.374188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:51.374758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:51.381704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:51.382194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:51.382627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:51.383321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:51.383773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:51.384196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:51.507921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:51.516300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:51.518395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:51.519547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1452ed8a-213c-48e3-b382-d3865aa0e1c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149298 Oct 15 08:51:51.520098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 334/670] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:52.544480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:52.545078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:52.551469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:52.551942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:52.552365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:52.553034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:52.553479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:52.553925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:52.681033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:52.689653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:52.691126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:52.692266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bf4ac0fa-5b08-4c61-8f59-ef6b43f88571 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151687 Oct 15 08:51:52.692801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 337/671] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:53.718308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:53.718918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:53.725826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:53.726310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:53.726767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:53.727449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:53.727897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:53.728316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:53.857197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:53.866320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:53.867753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:53.868912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e05dd26-ad62-4df5-80a4-23177c2f44dc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154491 Oct 15 08:51:53.869471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 335/672] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:54.896011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:54.896617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:54.903014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:54.903492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:54.903927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:54.904614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:54.905065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:54.905490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:55.038462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:55.047349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:55.049059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:55.050381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6f133be3-1118-4a40-acb4-ab34d8c667fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.159026 Oct 15 08:51:55.051081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 338/673] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:56.075969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:56.076574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:56.084140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:56.084637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:56.085034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:56.085740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:56.086193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:56.086618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:56.216511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:56.225472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:56.226911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:56.228109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f1f6cd69-58c1-46be-bea3-3f7453eea336 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155935 Oct 15 08:51:56.228653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 336/674] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:56 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:57.254180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:57.254792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:57.261271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:57.261785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:57.262225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:57.262909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:57.263365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:57.263791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:57.388367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:57.397995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:57.399416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:57.400667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b900f05c-1bb9-4996-b6c2-d24dd6ff0a1a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150858 Oct 15 08:51:57.401134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 339/675] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:51:58.425652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:58.426279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:58.432606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:58.433080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:58.433505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:58.434212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:58.434655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:58.435070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:58.564515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:58.573184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:58.574662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:58.575809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc94653b-5b6a-4205-bb21-f6babdb270af tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154012 Oct 15 08:51:58.576362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 337/676] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:51:59.602271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:51:59.602907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:51:59.609236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:59.609859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:59.610299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:59.610984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:51:59.611438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:51:59.611861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:51:59.734987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:59.743462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:59.744888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:51:59.746063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3c7b9f34-6f16-4730-b06e-56fa688e50cc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147624 Oct 15 08:51:59.746613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 340/677] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:51:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:00.772027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:00.772632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:00.778967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:00.779444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:00.779877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:00.780556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:00.781006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:00.781701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:00.784817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:00.909224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:00.917735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:00.919168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:00.920315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a7197c05-85c9-49bc-9432-c1b5955afbce tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152647 Oct 15 08:52:00.920869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 338/678] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:01.945829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:01.946388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:01.952658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:01.953132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:01.953586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:01.954286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:01.954737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:01.955178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:02.079373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:02.088570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:02.090019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:02.091155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5ccfbc69-8b0b-4e00-a1b4-5b8b5c8e9532 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149338 Oct 15 08:52:02.091696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 341/679] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:03.116286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:03.116893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:03.123427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:03.123904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:03.124329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:03.125004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:03.125451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:03.125898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:03.251124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:03.260295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:03.261840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:03.263091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9c29c034-e3a9-40a7-9c91-970229b4f39e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150784 Oct 15 08:52:03.263650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 339/680] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:04.290801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:04.291424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:04.298071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:04.298552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:04.299569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:04.300254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:04.300699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:04.301118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:04.435170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:04.443711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:04.445127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:04.446296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-080d8559-4bd9-4e1f-bc16-a45457523b1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.159405 Oct 15 08:52:04.446843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 342/681] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:04 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:05.472176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:05.472784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:05.475122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:05.480219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:05.480695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:05.481133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:05.481850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:05.482304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:05.482724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:05.608686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:05.617312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:05.618768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:05.619915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-357815df-0710-463e-8bc8-496f3845ceec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151627 Oct 15 08:52:05.620480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 340/682] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:06.646056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:06.646690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:06.652731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:06.653154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:06.653586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:06.654294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:06.654749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:06.655177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:06.785465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:06.794102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:06.795541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:06.796692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-53bf903e-b687-4988-add9-29f9a6389bd4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155006 Oct 15 08:52:06.797239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 343/683] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:07.822403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:07.823015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:07.828932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:07.829409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:07.829959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:07.831205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:07.831661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:07.832085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:07.958589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:07.967180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:07.968625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:07.969796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a614cb01-f9aa-4c2f-ad1b-bdb48c942f92 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151436 Oct 15 08:52:07.970344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 341/684] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:08.997853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:08.998461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:09.000816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:09.005991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:09.006468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:09.007062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:09.007578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:09.008031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:09.008452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:09.143371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:09.151842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:09.153273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:09.154437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fde0bb65-b621-4036-b3e2-584c955c503f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.160484 Oct 15 08:52:09.154989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 344/685] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:10.180890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:10.181493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:10.187766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:10.188237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:10.188667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:10.189380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:10.189857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:10.190274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:10.315361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:10.323736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:10.325152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:10.326321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cd75ae22-3a7f-4afc-bbb3-498599d91a3f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149267 Oct 15 08:52:10.326874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 342/686] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:10 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:11.353580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:11.354278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:11.360587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:11.361063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:11.361554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:11.362271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:11.362717 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:11.363132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:11.365577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:11.487362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:11.495810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:11.497224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:11.498390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f8012d40-0064-46ef-b025-106f67504da6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148633 Oct 15 08:52:11.498939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 345/687] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:12.530630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:12.531277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:12.537931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:12.538419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:12.538850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:12.539540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:12.539995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:12.540420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:12.668252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:12.677216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:12.678674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:12.679828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1e583ecb-bcb4-4713-8563-6d7820746772 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153082 Oct 15 08:52:12.680381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 343/688] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:13.707634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:13.708249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:13.714843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:13.715327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:13.715760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:13.716446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:13.716903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:13.717326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:13.843301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:13.853153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:13.854626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:13.855820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-06335dae-ddb3-4d8d-ba7f-0ba7d9a2facd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152093 Oct 15 08:52:13.856642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 346/689] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:14.882130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:14.882797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:14.890751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:14.891365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:14.891802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:14.892604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:14.893133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:14.893560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:15.024835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:15.034140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:15.035599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:15.036750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fa8f8181-0011-44af-b359-a718571faead tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.158494 Oct 15 08:52:15.037325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 344/690] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:16.062177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:16.062894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:16.069931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:16.070414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:16.070845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:16.071534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:16.071985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:16.072412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:16.200749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:16.209334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:16.210780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:16.211912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9c4e3504-88ef-478b-ac52-a2d7e0365c50 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153549 Oct 15 08:52:16.212453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 347/691] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:17.237228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:17.237862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:17.244191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:17.244663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:17.245092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:17.245805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:17.246259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:17.246672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:17.369845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:17.378435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:17.379849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:17.380996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0f29832b-86cd-4d6f-90f9-c5445f1b81f9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147619 Oct 15 08:52:17.381544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 345/692] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:18.408555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:18.409164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:18.415625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:18.416103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:18.416530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:18.417211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:18.417654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:18.418097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:18.546434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:18.555580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:18.557065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:18.558254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f663f26-f215-41fa-90dd-7ad3f5345200 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154517 Oct 15 08:52:18.558806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 348/693] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:19.583929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:19.584530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:19.591151 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:19.591636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:19.592066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:19.592761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:19.593212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:19.593633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:19.716242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:19.725183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:19.726641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:19.727821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a03c2dfc-ab6d-4213-8241-76627779e0ae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148288 Oct 15 08:52:19.728373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 346/694] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:20.754042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:20.754666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:20.761045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:20.761522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:20.761979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:20.762666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:20.763144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:20.763566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:20.895020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:20.903459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:20.904885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:20.906059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b3eae6e5-5e4a-4363-850c-1d3501f89efc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156382 Oct 15 08:52:20.906614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 349/695] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:21.932267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:21.932796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:21.939737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:21.940231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:21.940659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:21.941332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:21.941804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:21.942222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:22.065050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:22.073485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:22.074937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:22.076075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0f4e810b-b59f-438f-9803-e689dfeef0d1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147780 Oct 15 08:52:22.076624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 347/696] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:23.101512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:23.102145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:23.108584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:23.109091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:23.109523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:23.110245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:23.110705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:23.111681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:23.240039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:23.248510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:23.249957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:23.251192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef26a12e-b98f-47d8-b4bb-6d5f8d5eeeea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153507 Oct 15 08:52:23.252402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 350/697] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:24.277117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:24.277738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:24.284909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:24.285378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:24.285829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:24.286507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:24.286960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:24.287377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:24.413488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:24.422224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:24.424344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:24.425504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1df0936e-88cc-4c9f-bdc3-b256067f9e83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152324 Oct 15 08:52:24.426096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 348/698] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:25.451270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:25.451648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:25.458054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:25.458540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:25.458973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:25.459663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:25.460116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:25.460540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:25.591107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:25.599725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:25.601160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:25.602338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a421b2f5-b44f-42cc-9780-11ac0b355849 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155300 Oct 15 08:52:25.602878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 351/699] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:26.628422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:26.629423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:26.636024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:26.636707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:26.637244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:26.637969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:26.638422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:26.638843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:26.922887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:26.931409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:26.932844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:26.934021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-387d6fd4-62ba-4c12-b059-ba6269921853 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.309926 Oct 15 08:52:26.934573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 349/700] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:27.959992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:27.960594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:27.967041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:27.967541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:27.967971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:27.968680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:27.969123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:27.969538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:28.092389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:28.101326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:28.102773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:28.103907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f775e531-9640-4fa9-9397-11c35e474904 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147795 Oct 15 08:52:28.104453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 352/701] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:29.129948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:29.130557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:29.136861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:29.137345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:29.137811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:29.138501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:29.138956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:29.139380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:29.265018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:29.274075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:29.275500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:29.276652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46a4d993-d2f8-46bf-862a-bb8f4fd7ec5b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150673 Oct 15 08:52:29.277205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 350/702] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:29 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:30.302753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:30.303355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:30.309782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:30.310374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:30.310813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:30.311496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:30.311946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:30.312371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:30.438575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:30.446991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:30.448462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:30.449631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2cd51fe9-918b-43d9-bc0a-1f31bb4884fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150719 Oct 15 08:52:30.450203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 353/703] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:30 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:31.474802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:31.475416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:31.481819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:31.482303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:31.482735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:31.483417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:31.483867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:31.484289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:31.487312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:31.609589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:31.618278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:31.619706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:31.620857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2a841a64-d82e-4215-a74e-b259cfecbb8a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149935 Oct 15 08:52:31.621396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 351/704] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:32.646135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:32.646737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:32.653291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:32.653744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:32.654181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:32.654863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:32.655317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:32.655741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:32.783418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:32.791920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:32.793356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:32.794605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1abc8660-34c7-43b7-b147-c535b7ddde67 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152399 Oct 15 08:52:32.795161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 354/705] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:33.820433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:33.821047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:33.827459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:33.827941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:33.828374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:33.829076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:33.829524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:33.829978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:33.969007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:33.978260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:33.979715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:33.980922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a02825c6-5b53-47b8-9afe-d1af7aed3e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.164486 Oct 15 08:52:33.981886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 352/706] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:35.007968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:35.008580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:35.014990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:35.015477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:35.015911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:35.016597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:35.017632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:35.018095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:35.160753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:35.169471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:35.170943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:35.172092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-373b5e30-6bd3-4dc6-9182-612547ae5ed1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.167943 Oct 15 08:52:35.172640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 355/707] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:36.199312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:36.199953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:36.201973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:36.207619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:36.208107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:36.208539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:36.209231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:36.209709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:36.210129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:36.341734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:36.351776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:36.353359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:36.354623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2de986af-3034-4608-a94d-d7c4d097ed83 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.160062 Oct 15 08:52:36.365946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 353/708] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:36 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:37.381181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:37.381819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:37.389090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:37.389586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:37.390045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:37.390734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:37.391185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:37.391601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:37.524399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:37.533774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:37.535218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:37.536374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8c603fa9-1ea5-4fb2-b2bd-e29d91914f20 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.160024 Oct 15 08:52:37.536923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 356/709] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:37 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:38.562044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:38.562651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:38.569071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:38.569556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:38.570026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:38.570712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:38.571166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:38.571589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:38.697482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:38.705964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:38.707391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:38.708526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e2174853-8de3-426f-af34-f71d31b85fe0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150530 Oct 15 08:52:38.709073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 354/710] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:39.734312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:39.734909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:39.737295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:39.742563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:39.743038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:39.743465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:39.744140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:39.744585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:39.745003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:39.871618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:39.880642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:39.882065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:39.883216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cd0aacc1-e2a5-40b5-b5dc-89a8a591be26 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152808 Oct 15 08:52:39.883760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 357/711] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:40.909015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:40.909616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:40.916050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:40.916527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:40.916953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:40.917629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:40.918099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:40.918521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:41.042619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:41.051710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:41.053133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:41.054301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a59c5b6a-2b02-47fa-8d6e-d9a8c35fc0d9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149920 Oct 15 08:52:41.054844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 355/712] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:42.080227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:42.080869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:42.087222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:42.087698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:42.088124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:42.088801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:42.089277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:42.089714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:42.092210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:42.216915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:42.226039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:42.227464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:42.228601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-811d05b7-6400-4024-998f-5b11f8507fea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152366 Oct 15 08:52:42.229147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 358/713] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:42 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:43.254999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:43.255614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:43.261940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:43.262422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:43.262854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:43.263655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:43.264010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:43.264440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:43.389527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:43.398159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:43.399584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:43.400736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d1c928f-259b-4170-806b-416bcdd28c43 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150154 Oct 15 08:52:43.401283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 356/714] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:44.426603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:44.427205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:44.433576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.434098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.434527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.435206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.435656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.436079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.564735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:44.573866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:44.575533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:44.576554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:44.577091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:44.577970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1c1b8b6a-82a1-462a-b234-42250d5be229 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155860 Oct 15 08:52:44.578692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 359/715] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:44.584608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.585091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.585518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.586231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.586683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.587103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.612876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:52:44.693916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-36945cf0-ae3b-40c3-8fdb-0b2e80ed1134 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 204 len: 0 microversion: 2.1 time: 0.120572 Oct 15 08:52:44.694775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 357/716] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:52:44 2022] DELETE /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 15 08:52:44.702599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:44.703208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:44.709723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.710188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.710620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.711292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:44.711735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:44.712152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:44.843386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:44.851535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cc9ecca9-817a-48cd-95a6-1f1ffe291142 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1680 microversion: 2.1 time: 0.152730 Oct 15 08:52:44.852083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 360/717] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:44 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:45.605109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:45.605862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:45.614549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:45.615042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:45.615482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:45.616188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:45.616654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:45.617390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:45.875361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:45.876790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:45.881994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:45.884330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:45.884888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:45.885394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:45.886261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:45.886783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:45.887631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:45.894807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:45.896651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:45.899706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-59cfbd9c-666b-44ac-a803-a81dd03bcf3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.298506 Oct 15 08:52:45.900674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 358/718] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:46.006324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:46.014389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f3d321a6-e200-4419-828b-abe8095535d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1613 microversion: 2.1 time: 0.143028 Oct 15 08:52:46.014959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 361/719] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:45 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1613 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:46.929598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:46.930953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:46.941754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:46.960790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:46.961545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:46.962346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:46.962810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:46.964577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:47.049093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28480cd2-5ae8-4292-9c17-be983439b53f", "name": "network-vif-deleted", "tag": "e3f7288d-02e9-4885-aec1-fcc6483c4bb1"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:52:47.086592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:47.091424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:47.092142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:47.123827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] Creating event network-vif-deleted:e3f7288d-02e9-4885-aec1-fcc6483c4bb1 for instance 28480cd2-5ae8-4292-9c17-be983439b53f on hv-cinder-85697 Oct 15 08:52:47.130917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-7f3dc2c5-024f-431e-81f1-5721a5014234 req-ca0d73c2-13bb-4207-9397-6b9b8ddcc012 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442993 Oct 15 08:52:47.131536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 359/720] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:52:47.139987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:47.140711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:47.150106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:47.150952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:47.151612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:47.154120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:47.154803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:47.155398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:47.167639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:47.178459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:47.181339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:47.183425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8fed7323-143f-43bf-9ea7-de96bbf2be2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.260294 Oct 15 08:52:47.184543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 362/721] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:47.193129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:47.193918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:47.194511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:47.195123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lazy-loading 'fault' on Instance uuid 28480cd2-5ae8-4292-9c17-be983439b53f {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:52:47.246026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:47.256592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a5de0df5-18d6-4419-83e0-9d65b9b1399d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 200 len: 1419 microversion: 2.1 time: 0.123398 Oct 15 08:52:47.270915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 360/722] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:47 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 1419 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:48.209208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:48.209843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:48.216195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:48.216668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:48.217097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:48.217798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:48.218250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:48.218666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:48.283545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:48.284156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:48.290746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:48.291295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:48.291831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:48.292524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:48.292976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:48.293392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:48.313253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f HTTP/1.1 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:52:48.315045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 08:52:48.316668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '28480cd2-5ae8-4292-9c17-be983439b53f'} Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:52:48.317589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 08:52:48.319708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:52:48.320804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:52:48.320804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d3d802f-ab67-4d8b-bb64-41524c7a4f34 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 404 len: 111 microversion: 2.1 time: 0.038686 Oct 15 08:52:48.320804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 361/723] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:48 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 08:52:48.326836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-37b08229-7667-48c8-ad9a-ded148880fbb tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '.version_select at 0x7f575ac6a4c0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:48.331217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-37b08229-7667-48c8-ad9a-ded148880fbb tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [49bf738f-fd57-4e09-9d69-0c4cf0477311] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 08:52:48.353742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:48.362834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:48.364267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:48.365421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2e16028f-f215-412e-a141-93a991490875 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.160078 Oct 15 08:52:48.366215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 363/724] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:48 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:49.338078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-37b08229-7667-48c8-ad9a-ded148880fbb tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [49bf738f-fd57-4e09-9d69-0c4cf0477311] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41730. Oct 15 08:52:49.358153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-37b08229-7667-48c8-ad9a-ded148880fbb tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-498952549" status: 202 len: 0 microversion: 2.1 time: 1.034866 Oct 15 08:52:49.358713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 362/725] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 08:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-498952549 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 08:52:49.390705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:49.391420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:49.398440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:49.399143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:49.399580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:49.400279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:49.401131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:49.401337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:49.578646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:49.587989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:49.589412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:49.590596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-171511ce-3ccd-454c-acac-8dfae0d3de8d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.203914 Oct 15 08:52:49.591166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 364/726] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:50.106474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0b84f290-3954-4c60-9e16-dbe6f7e33f02 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: .version_select at 0x7f575ac6a3a0>, body: {"keypair": {"name": "tempest-keypair-789283564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlabozLLNCkgmpIvU+vn/K+8N3j32Yu+RVW7SZBAeHqpj/fLJSmNkzKhzyGium2diRIVBiiQrdWloNWUWf8xksWGcDmLa+RS31zR3rtCJeiu0pOnFPlfWClQKp9vikMhA=="}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:52:50.121752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-0b84f290-3954-4c60-9e16-dbe6f7e33f02 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:52:50.125480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-0b84f290-3954-4c60-9e16-dbe6f7e33f02 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:52:50.147000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0b84f290-3954-4c60-9e16-dbe6f7e33f02 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044363 Oct 15 08:52:50.147610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 363/727] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 08:52:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:52:50.617117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:50.617759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:50.624225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:50.624707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:50.625143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:50.625868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:50.626838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:50.627262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:50.827576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:50.836759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:50.838202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:50.839362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-70fb2483-7f63-478f-a2a8-11b657609f13 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.226325 Oct 15 08:52:50.839916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 365/728] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:51.388285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-869465386", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abd5286e-7177-474d-b9f2-9ade4753e5ec"}], "security_groups": [{"name": "tempest-securitygroup--889542767"}], "key_name": "tempest-keypair-789283564", "user_data": "}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:52:51.489055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] validate_networks() for [('abd5286e-7177-474d-b9f2-9ade4753e5ec', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:52:51.865097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:51.865768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:51.872032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:51.872557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:51.873013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:51.873711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:51.874171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:51.874588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:52.021178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:52:52.021839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:52:52.022410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:52:52.022912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:52:52.023413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:52:52.033066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:52.034013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:52.034572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:52.035410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:52.035958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:52.036477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:52.056769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:52.057374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:52:52.062899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:52:52.069203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:52.072689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:52.072689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b4ad6572-61d0-4bda-82ab-1ced37231d1b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.211358 Oct 15 08:52:52.072689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 366/729] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:52:52.075227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:52:52.077623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:52:52.122528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [6810e88e-90be-408b-91cb-6e5460c1e935] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 08:52:53.097005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:53.097606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:53.104055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:53.104539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:53.104963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:53.105653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:53.106122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:53.106539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:53.130500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [6810e88e-90be-408b-91cb-6e5460c1e935] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 41812. Oct 15 08:52:53.134670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2143a649-4ab9-465f-b948-da56d48ac0aa tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.751228 Oct 15 08:52:53.140680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 364/730] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:52:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:52:53.147565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1fe64c0d-538b-4254-b873-51fdd9860d6b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:53.148186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1fe64c0d-538b-4254-b873-51fdd9860d6b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:53.205480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1fe64c0d-538b-4254-b873-51fdd9860d6b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:53.212337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1fe64c0d-538b-4254-b873-51fdd9860d6b tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1240 microversion: 2.1 time: 0.069082 Oct 15 08:52:53.212944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 365/731] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:53 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:52:53.230576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:53.231306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:53.237363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:53.237845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:53.238285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:53.239297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:53.239451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:53.239879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:53.265330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:53.275337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:53.276932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:53.278447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a132d135-6725-4fb1-b890-a53f0c2071bd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.185992 Oct 15 08:52:53.279064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 367/732] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:52:53.325754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lazy-loading 'services' on Instance uuid 83c9eb9c-612a-4b42-8103-e2bb037d1f39 {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:52:53.400900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3341b8e3-87be-4806-a2f2-5589bec47694 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39/os-volume_attachments/44736cc1-2043-4bf9-8c76-df1be9dd362d" status: 202 len: 0 microversion: 2.1 time: 0.173779 Oct 15 08:52:53.401330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 366/733] 10.222.0.30 () {58 vars in 1416 bytes} [Sat Oct 15 08:52:53 2022] DELETE /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39/os-volume_attachments/44736cc1-2043-4bf9-8c76-df1be9dd362d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:52:54.239891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7abc41d9-fbfd-41fd-90e6-cf2e5cc8cbfd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:54.240496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7abc41d9-fbfd-41fd-90e6-cf2e5cc8cbfd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:54.295104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7abc41d9-fbfd-41fd-90e6-cf2e5cc8cbfd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:54.305344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:54.305840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7abc41d9-fbfd-41fd-90e6-cf2e5cc8cbfd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1240 microversion: 2.1 time: 0.069714 Oct 15 08:52:54.305956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 368/734] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:54 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:54.311712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:54.320132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:54.320622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:54.321060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:54.321822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:54.322405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:54.322834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:54.450123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:54.458594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:54.460017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:54.461169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aeaa687f-cf36-4dea-a0be-321b6f53c10c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.159940 Oct 15 08:52:54.461732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 367/735] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:54 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:52:55.327904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-148e3cec-96ea-4561-9340-c347374f7bef tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:55.328634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-148e3cec-96ea-4561-9340-c347374f7bef tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:55.385368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-148e3cec-96ea-4561-9340-c347374f7bef tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:55.395432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-148e3cec-96ea-4561-9340-c347374f7bef tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1240 microversion: 2.1 time: 0.071179 Oct 15 08:52:55.396239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 369/736] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:55 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:55.487143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:55.487875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:55.496496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:55.498379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:55.498942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:55.499931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:55.500538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:55.501617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:55.653971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:55.663299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:55.664722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:55.665911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3dc86a0a-322e-4896-8374-bff593244645 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.182859 Oct 15 08:52:55.666467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 368/737] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:56.419780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:56.420316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:56.426715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:56.427200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:56.427631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:56.428321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:56.428771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:56.429191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:56.507311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:56.515222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2db5395c-6916-4272-ad53-a2503c3d9dd0 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1310 microversion: 2.1 time: 0.099639 Oct 15 08:52:56.515781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 370/738] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:56 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:56.694612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:56.695224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:56.702524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:56.703005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:56.703428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:56.704151 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:56.705141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:56.705556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:56.894520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:56.903185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:56.904647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:56.905836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-13c69367-3479-4d0f-a4d8-48fa4e1daf30 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.215107 Oct 15 08:52:56.906402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 369/739] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:56 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:57.539495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:57.540136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:57.546784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:57.547261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:57.547692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:57.548997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:57.549450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:57.549913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:57.746744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:57.754927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b5011f49-64e0-4b0d-9ba8-d9b08a94ee6a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.219225 Oct 15 08:52:57.755613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 371/740] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:57 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:57.846993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d591419c-18a4-4e6b-a087-d9a2b4edaf8f", "tag": "31414928-82a8-4928-adbe-1352569c1769"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:52:57.859139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:57.859613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:57.860157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:57.864817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:52:57.873318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] Creating event network-changed:31414928-82a8-4928-adbe-1352569c1769 for instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f on hv-cinder-85697 Oct 15 08:52:57.879635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-b6bee83f-d74c-434b-867d-a44e96e6c0eb req-580161a6-caa4-4837-9c2b-1e43085c3e52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036341 Oct 15 08:52:57.880565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 370/741] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:52:57.932475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:57.933078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:57.939619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:57.940653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:57.941090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:57.941798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:57.942249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:57.942671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:58.138605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:58.147906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:58.149342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:58.150665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fa9b61ce-a08b-4b6c-a039-6e60d1879d22 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.222119 Oct 15 08:52:58.151226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 372/742] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:52:58.779693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:58.780426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:58.788449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:58.788929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:58.789366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:58.790074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:58.790532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:58.790949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:59.177330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:52:59.178037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:52:59.185134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:59.185704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:59.186254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:59.187001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:52:59.187516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:52:59.187999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:52:59.222624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:59.231044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e8a07c2c-87eb-4034-9c97-d5f13a6b2edc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.455643 Oct 15 08:52:59.231614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 371/743] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:52:58 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:52:59.403146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:59.412799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:59.414282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:52:59.415574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5715d155-c300-40ca-9b00-8a1b0fbb48e5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.242813 Oct 15 08:52:59.416230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 373/744] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:52:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:53:00.254264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:00.254883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:00.261308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:00.261820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:00.262259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:00.262948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:00.263404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:00.263828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:00.396946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:00.404856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-983edc92-e821-4d61-94ae-b47fa5072cbf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.154375 Oct 15 08:53:00.405421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 372/745] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:00 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:00.440806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:00.441415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:00.448034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:00.448510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:00.448935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:00.449756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:00.450216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:00.450642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:00.576723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:00.585637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:00.587072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:00.588226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-35c35d0b-3bf5-4c88-9ad1-6eb275a39b91 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151871 Oct 15 08:53:00.588761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 374/746] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:00 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:01.428222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:01.428941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:01.435509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:01.435997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:01.436431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:01.437122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:01.437580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:01.438033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:01.577558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:01.585464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3cde617f-30f1-41ca-97af-690cd095e828 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.161121 Oct 15 08:53:01.586069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 373/747] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:01 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:01.614469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:01.615073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:01.621575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:01.622086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:01.622520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:01.623206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:01.623688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:01.624111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:01.756608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:01.765099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:01.766542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:01.767684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aa18e4b8-21e4-4848-a0e6-c0c3bcb0e67d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.157625 Oct 15 08:53:01.768785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 375/748] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:02.607766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:02.608401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:02.610404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:02.616334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:02.616813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:02.617240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:02.617989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:02.618444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:02.618861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:02.743669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:02.751559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a5e81f52-01a8-4004-935d-ff2cf4e6d43f tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.147686 Oct 15 08:53:02.752126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 374/749] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:02 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:02.794494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:02.795059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:02.802045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:02.802526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:02.802953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:02.803629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:02.804075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:02.804489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:02.933844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:02.936003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:02.943622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:02.945059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:02.946254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1733c51a-7329-4dfe-9e96-421b1028b438 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155688 Oct 15 08:53:02.946807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 376/750] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:03.459700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=12 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:03.515528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d591419c-18a4-4e6b-a087-d9a2b4edaf8f", "name": "network-vif-plugged", "status": "completed", "tag": "31414928-82a8-4928-adbe-1352569c1769"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:53:03.526346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:03.526822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:03.527299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:03.538133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] Creating event network-vif-plugged:31414928-82a8-4928-adbe-1352569c1769 for instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f on hv-cinder-85697 Oct 15 08:53:03.543127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-b78f230c-d8e3-469b-bcad-2a940e6b0610 req-e88c4d9e-3337-4268-8619-88f70a149f56 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087894 Oct 15 08:53:03.543702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 375/751] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:53:03.773731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:03.774377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:03.780245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:03.780728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:03.781162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:03.781885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:03.783245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:03.783674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:03.906325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:03.914627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3324ce4a-5cae-4a86-bf27-f3afbdc5c0d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.144817 Oct 15 08:53:03.915187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 377/752] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:03 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:03.973076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:03.973821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:03.980405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:03.980883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:03.981310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:03.982019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:03.982468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:03.982882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:04.119675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:04.128763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:04.130203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:04.131344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dfc426aa-8234-4029-b387-f36ef330b759 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.163030 Oct 15 08:53:04.131898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 376/753] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:04.937926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:04.938531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:04.944803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:04.945282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:04.945743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:04.946431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:04.946884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:04.947308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:05.072966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:05.081672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-efa2e8ec-3872-4ab6-b7f0-b4b709544d77 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1365 microversion: 2.1 time: 0.147167 Oct 15 08:53:05.082266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 378/754] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:04 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:05.158570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:05.159233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:05.166241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:05.166778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:05.167401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:05.168087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:05.168690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:05.169111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:05.303907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:05.312590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:05.314038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:05.315187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f7adfcf2-bae3-490e-8607-735b6c3af530 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.162542 Oct 15 08:53:05.315733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 377/755] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:06.104789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:06.105397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:06.107221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:06.113613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.114136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.114565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.115237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.115685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.116104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.244046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:06.251720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01ceb9f2-1436-4621-9f54-e48df26d3d07 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1556 microversion: 2.1 time: 0.150705 Oct 15 08:53:06.252277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 379/756] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:53:06 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:53:06.273956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:06.274456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:06.276380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:06.281581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.282650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.283340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.284031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.284487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.284913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.341387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:06.342017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:06.348358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.348840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.349274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.350010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:06.350464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:06.350886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:06.363249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-066f68da-1c57-49da-8ae1-cdddb5a3afac tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093772 Oct 15 08:53:06.363920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 378/757] 10.222.0.30 () {58 vars in 1275 bytes} [Sat Oct 15 08:53:06 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:53:06.477655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:53:06.478142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:53:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:53:06.632820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:06.642082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:06.643550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:06.644714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7939d0f2-3b00-4545-9860-9fb0eb8611fc tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.307271 Oct 15 08:53:06.645264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 380/758] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:06 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:53:07.344160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d591419c-18a4-4e6b-a087-d9a2b4edaf8f", "tag": "31414928-82a8-4928-adbe-1352569c1769"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:53:07.353430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:07.353942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:07.354375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:07.366517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] Creating event network-changed:31414928-82a8-4928-adbe-1352569c1769 for instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f on hv-cinder-85697 Oct 15 08:53:07.378052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-573f7a68-7201-4d1a-a611-c8b834934db3 req-7b86d615-8f84-43ee-8160-379b7a052783 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031397 Oct 15 08:53:07.378052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 379/759] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:53:07.671025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:07.671621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:07.678050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:07.678453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:07.679066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:07.679570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:07.680025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:07.680447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:07.922593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:07.932588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:07.934060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:07.935442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8966176-e210-42c8-8de4-02687baef40f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.268311 Oct 15 08:53:07.936307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 381/760] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:07 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:08.962242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:08.962943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:08.969232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:08.970325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:08.970774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:08.971467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:08.971931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:08.972358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:09.097325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:09.105871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:09.107326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:09.108492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b29d43d8-4a94-4aa4-8c47-8f2e3498f781 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151361 Oct 15 08:53:09.109050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 380/761] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:08 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:10.134841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:10.135449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:10.137831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=54 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:10.143061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:10.143535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:10.143965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:10.144645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:10.145101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:10.145522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:10.275049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:10.284434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:10.285892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:10.287044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f9940387-9357-4dfa-9ce2-d1d72439c377 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156069 Oct 15 08:53:10.287599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 382/762] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:10 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:11.312923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:11.313539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:11.320030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:11.320510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:11.320943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:11.321626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:11.322113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:11.322535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:11.450288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:11.459409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:11.460828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:11.462000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-45260c18-afb2-4c7b-b367-8bb914959a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152979 Oct 15 08:53:11.462552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 381/763] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:11 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:12.487607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:12.488238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:12.494643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:12.495119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:12.495546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:12.496221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:12.496669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:12.497084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:12.626171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:12.635486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:12.636932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:12.638176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6589dffa-5356-4d89-949f-4bdd0af91825 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154390 Oct 15 08:53:12.638734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 383/764] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:12 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:13.664727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:13.665386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:13.671895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:13.672365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:13.672789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:13.673463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:13.673965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:13.674429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:13.799590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:13.807964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:13.809404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:13.810582 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-202a46a2-1af3-4398-b87a-00d82b558590 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149778 Oct 15 08:53:13.811156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 382/765] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:13 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:14.836259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:14.836865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:14.844046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:14.844328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:14.844762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:14.845444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:14.845928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:14.846354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:14.972647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:14.981184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:14.982661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:14.983805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7cef3ad1-d02e-4b87-9dbd-a3588dddd67c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151419 Oct 15 08:53:14.984361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 384/766] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:14 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:16.010834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:16.011451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:16.017935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:16.018419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:16.018854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:16.019544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:16.020003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:16.020432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:16.151625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:16.161196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:16.162661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:16.163840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-50e3e7dd-c03a-4b34-ad61-ddade3f2cb00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156879 Oct 15 08:53:16.164386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 383/767] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:16 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:17.189457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:17.190784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:17.197450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:17.197971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:17.198405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:17.199085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:17.199533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:17.199954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:17.323648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:17.333013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:17.334462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:17.335606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f0572692-4338-4b00-9edf-7c1699b30cae tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150068 Oct 15 08:53:17.336154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 385/768] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:17 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:18.361763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:18.362308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:18.368372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:18.368849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:18.369285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:18.369996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:18.370446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:18.370868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:18.501840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:18.510315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:18.511732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:18.512868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-584ff5d9-dee6-407e-81f4-285f52954095 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.155118 Oct 15 08:53:18.513417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 384/769] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:18 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:19.539493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:19.540097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:19.546524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:19.547003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:19.547433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:19.548114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:19.548569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:19.548990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:19.673866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:19.682355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:19.683784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:19.684933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-73ef0fd3-41a7-439f-86e5-0b90afb6e932 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149961 Oct 15 08:53:19.685479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 386/770] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:19 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:20.710593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:20.711123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:20.717527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:20.718038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:20.718474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:20.719364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:20.719830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:20.720260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:20.842768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:20.851858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:20.853301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:20.854495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7a01a222-5c09-47a1-a0e0-38064c849227 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147884 Oct 15 08:53:20.855054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 385/771] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:20 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:21.879772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:21.880373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:21.886715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:21.887229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:21.887654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:21.888330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:21.888802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:21.889226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:22.015767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:22.024486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:22.025943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:22.027107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7f5aeebd-62d6-4644-9a24-de0a60c4e010 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151900 Oct 15 08:53:22.027642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 387/772] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:21 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:23.052073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:23.052721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:23.059210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:23.059686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:23.060111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:23.060798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:23.061246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:23.061663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:23.185983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:23.194434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:23.195849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:23.196992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-68cdc590-36b7-4f48-9573-72de3ab9e332 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148751 Oct 15 08:53:23.197541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 386/773] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:23 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:24.223060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:24.223660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:24.226121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:53:24.226285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:53:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df (ip 10.222.0.30) !!! Oct 15 08:53:24.231878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:24.232355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:24.232784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:24.233467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:24.233949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:24.234426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:24.368589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:24.377263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:24.379325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:24.380497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-44cca40d-3431-4988-8da4-146ee838dba1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.161408 Oct 15 08:53:24.381048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 388/774] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:24 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:25.406996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:25.407609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:25.415152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:25.415630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:25.416058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:25.416776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:25.417222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:25.417638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:25.542338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:25.550789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:25.552216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:25.553356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4d301a16-48a3-4360-9874-403677fe189f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150322 Oct 15 08:53:25.553935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 387/775] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:25 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:26.578153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:26.578758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:26.585736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:26.586238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:26.586652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:26.587331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:26.587781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:26.588201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:26.717950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:26.726476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:26.727890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:26.729026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-65f09ccd-6c60-4075-bf94-c8ec010296fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154755 Oct 15 08:53:26.729572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 389/776] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:26 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:27.755300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:27.755925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:27.766546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:27.767025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:27.767450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:27.768131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:27.768597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:27.768995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:27.892059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:27.900575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:27.902051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:27.903225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5a0df8e7-7763-4193-bf3b-4812f02374cf tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152415 Oct 15 08:53:27.903779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 388/777] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:27 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 15 08:53:28.929508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:28.930077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:28.936418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:28.936894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:28.937324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:28.938032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:28.938483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:28.938903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:29.076562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:29.085170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:29.086618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:29.087753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-237af69a-8132-4a23-81c8-0b98a1cf6290 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.162229 Oct 15 08:53:29.088303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 390/778] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:28 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:30.112261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:30.112875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:30.119286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:30.119766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:30.120198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:30.120880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:30.121367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:30.122048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:30.124687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:30.251550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:30.260581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:30.262026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:30.263180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a9d62519-cf1c-4d0c-83a5-b7508cf6f231 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154857 Oct 15 08:53:30.263728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 389/779] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:30 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:31.288965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:31.289529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:31.295890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:31.296364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:31.296790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:31.297462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:31.297936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:31.298357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:31.422292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:31.431219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:31.432631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:31.433809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-121dd298-9067-4e6c-b446-ec39ee4087c9 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148705 Oct 15 08:53:31.434353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 391/780] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:31 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:32.460540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:32.461168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:32.467535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:32.468009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:32.468435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:32.469116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:32.469562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:32.470011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:32.597995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:32.606568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:32.607983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:32.609134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8f987f66-6090-44c1-93ef-95203c5a686f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153168 Oct 15 08:53:32.609703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 390/781] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:32 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:33.634375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:33.634970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:33.641313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:33.641817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:33.642245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:33.642921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:33.643366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:33.643782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:33.647574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=92 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:33.766865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:33.775238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:33.776656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:33.777823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a08895cb-f67f-4ae5-9b75-65867dba51ec tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.147892 Oct 15 08:53:33.778369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 392/782] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:34.803922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:34.804533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:34.810861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:34.811340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:34.811771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:34.812449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:34.812903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:34.813322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:34.938330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:34.947555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:34.948974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:34.950164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-264ed9f6-d592-42c4-853b-053d8ac4c2fa tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150079 Oct 15 08:53:34.951002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 391/783] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:34 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:35.976387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:35.976995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:35.983112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:35.983593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:35.984056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:35.984715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:35.985164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:35.985584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:36.112257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:36.120771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:36.122219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:36.123628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-64faa63d-31ac-4580-960f-bda24cf6e29b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151372 Oct 15 08:53:36.124183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 393/784] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:35 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:37.150328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:37.150936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:37.152876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=28 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:37.158266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:37.159014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:37.159449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:37.160136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:37.160625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:37.161052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:37.286858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:37.295338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:37.296771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:37.297959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1eab4e7b-d37e-48d4-bfbf-7bb3343f51f4 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152331 Oct 15 08:53:37.298509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 392/785] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:37 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:38.324631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:38.325216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:38.331202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:38.331673 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:38.332107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:38.332779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:38.333853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:38.334273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:38.462901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:38.471404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:38.472815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:38.474274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2808fad3-5a7f-473d-833f-f6d97a78227f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153799 Oct 15 08:53:38.474818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 394/786] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:38 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:39.499447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:39.500060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:39.506499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:39.506995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:39.507410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:39.508092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:39.508541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:39.508964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:39.638432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:39.647474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:39.648899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:39.650166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-73a2bfce-ce5f-432c-a147-fa206968820c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154590 Oct 15 08:53:39.650650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 393/787] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:39 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:40.675771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:40.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:40.679580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:53:40.684727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:40.685199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:40.685627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:40.686330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:40.686777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:40.687193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:40.814011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:40.822463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:40.823876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:40.825015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6d1cd041-1ae8-4893-aae0-dee9fded08eb tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153049 Oct 15 08:53:40.825555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 395/788] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:40 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:41.850099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:41.850704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:41.857071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:41.857551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:41.858018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:41.858701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:41.859153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:41.859576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:41.982786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:41.992027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:41.993471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:41.994639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c4920389-b157-41e3-99eb-92f560a8a356 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148567 Oct 15 08:53:41.995199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 394/789] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:41 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:43.020428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:43.021069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:43.027518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:43.027991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:43.028418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:43.029095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:43.029545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:43.029985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:43.155710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:43.164908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:43.166370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:43.167513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5021aec2-2329-4d03-9370-8a4b8b51bbf7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151015 Oct 15 08:53:43.168065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 396/790] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:43 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:43.535984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:43.537084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:43.543492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:43.543972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:43.544406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:43.545086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:43.545542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:43.545993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:43.569149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b11d0b9b-e96f-4b13-9610-c37f0fd449e2 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f/ips" status: 200 len: 150 microversion: 2.1 time: 0.037251 Oct 15 08:53:43.569783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 395/791] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 08:53:43 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:53:44.194442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:44.195046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:44.201437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:44.201949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:44.202388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:44.203072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:44.203526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:44.203947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:44.581050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:44.589559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:44.591016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:44.592158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-38bcf33c-b577-4dfa-ab8c-cc6bebc848e6 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.402287 Oct 15 08:53:44.592708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 397/792] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:44 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:45.618371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:45.618975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:45.625345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:45.625858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:45.626290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:45.626965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:45.627418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:45.627836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:45.786105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:45.794815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:45.796258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:45.797429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0dea5656-beb2-4ac4-9ff4-b1d4a794b84d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.183460 Oct 15 08:53:45.798078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 396/793] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:45 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:46.823691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:46.824291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:46.830765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:46.831240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:46.831664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:46.832337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:46.832784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:46.833845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:46.957790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:46.966934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:46.968257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:46.969402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8e85dfd2-e511-427d-a27f-fecc944f14ee tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.149701 Oct 15 08:53:46.970067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 398/794] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:46 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:47.995637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:47.996260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:48.002767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:48.004356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:48.004356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:48.004612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:48.005085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:48.005497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:48.137789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:48.147076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:48.148532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:48.149705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7306a9a2-bc74-4da2-9c8c-10e70d6d0110 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.158306 Oct 15 08:53:48.150258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 397/795] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:47 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:49.174937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:49.175634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:49.182347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:49.182829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:49.183256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:49.183934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:49.184380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:49.184800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:49.311691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:49.320830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:49.322311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:49.323459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a7db38ca-67e5-43a1-82ac-29ffb8fbec3d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.152338 Oct 15 08:53:49.324022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 399/796] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:49 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:50.349666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:50.350536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:50.357569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:50.358085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:50.358521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:50.359204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:50.359656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:50.360073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:50.488749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:50.498118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:50.499556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:50.500711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ec18effc-ebdc-480e-9fc0-cd56d58a5c00 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.156308 Oct 15 08:53:50.501258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 398/797] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:50 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:51.526481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:51.527022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:51.533449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:51.534219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:51.534651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:51.535367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:51.535819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:51.536804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:51.665667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:51.674047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:51.675461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:51.676611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3649a85f-2273-48e5-ac0f-c3833b1b51e1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154057 Oct 15 08:53:51.677152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 400/798] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:51 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:52.700808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:52.701437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:52.707838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:52.708323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:52.708751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:52.709431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:52.709904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:52.710332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:52.853430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:52.862762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:52.864833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:52.866145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-20533c9c-8de1-4124-9d37-6803511b48e8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.169224 Oct 15 08:53:52.866802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 399/799] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:52 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:53.893020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:53.893549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:53.900494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:53.900967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:53.901394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:53.902103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:53.902557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:53.902984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:54.179643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:54.188090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:54.189512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:54.190675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f5cdbefc-fbc3-49e0-b9f1-296efa53e4b8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.301934 Oct 15 08:53:54.191211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 401/800] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:53 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:55.216337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:55.216849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:55.223337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:55.223863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:55.224292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:55.224966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:55.225411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:55.225863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:55.353829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:55.362222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:55.363641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:55.365297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c47b259e-b99c-454a-96e3-f761e745f1f5 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153017 Oct 15 08:53:55.365865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 400/801] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:55 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:56.390915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:56.391446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:56.397928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:56.398410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:56.398843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:56.399528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:56.399980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:56.400703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:56.525572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:56.534625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:56.536415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:56.537610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-473cc8a2-ef11-4968-9a33-ef1518de3c98 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.150674 Oct 15 08:53:56.538170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 402/802] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:56 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:57.564116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:57.564533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:57.572892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:57.573384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:57.573853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:57.574554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:57.575016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:57.575429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:57.702951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:57.711470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:57.712898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:57.714080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c35c4170-7c3c-439e-b443-9fb8896b7067 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154487 Oct 15 08:53:57.714633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 401/803] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:57 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:58.739002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:58.740220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:58.746524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:58.746998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:58.747423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:58.748102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:58.748548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:58.748977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:58.875841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:58.884396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:58.885861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:53:58.887007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-acd622c2-c660-401e-bb64-0e25281474f1 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.151860 Oct 15 08:53:58.887541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 403/804] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:58 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:53:59.913223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:53:59.913862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:53:59.920278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:59.920754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:59.921185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:53:59.921898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:53:59.922343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:53:59.922757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:00.057563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:00.066150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:00.068082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:00.069224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94870c25-3b22-4cbf-b309-04719d03c712 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.160830 Oct 15 08:54:00.069797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 402/805] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:53:59 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:01.095110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:01.095709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:01.102672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:01.103157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:01.103594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:01.104285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:01.104740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:01.105167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:01.228714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:01.237484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:01.238982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:01.240140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-daadf638-fe5e-4c75-90c6-0456183e6e05 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.148886 Oct 15 08:54:01.240680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 404/806] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:01 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:02.265841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:02.266362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:02.273095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:02.273569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:02.274030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:02.274706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:02.275155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:02.275573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:02.278064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=82 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:02.403721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:02.412987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:02.414450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:02.415603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-23b275c9-3f96-4e37-9c48-be2f38f83e4a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.153840 Oct 15 08:54:02.416150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 403/807] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:02 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:03.442267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:03.442868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:03.449438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.449960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.450423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.451114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.451572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.451989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.581401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:03.590454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:03.591883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:03.593029 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b938044f-9a81-4984-b78a-b33f1adae25e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 200 len: 1747 microversion: 2.20 time: 0.154688 Oct 15 08:54:03.593566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 405/808] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:03.678546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:03.679038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:03.685351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.685868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.686316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.686988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.687438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.687860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.920041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1f6eb6bc-af5f-4057-8076-9ef15b14f70e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments/76ba6eaf-7abd-4fde-bf84-8c53a1416815" status: 202 len: 0 microversion: 2.20 time: 0.245339 Oct 15 08:54:03.920641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 404/809] 10.222.0.30 () {60 vars in 1457 bytes} [Sat Oct 15 08:54:03 2022] DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments/76ba6eaf-7abd-4fde-bf84-8c53a1416815 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:54:03.929167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:03.931502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:03.938022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.938555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.939345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.940212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:03.940819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:03.941387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:03.945935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=84 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:03.976031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0001b625-b264-440c-80e8-7284e847ddb0 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050821 Oct 15 08:54:03.977262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 406/810] 10.222.0.30 () {60 vars in 1343 bytes} [Sat Oct 15 08:54:03 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:54:04.040034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:04.040527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:04.047508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:04.047994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:04.048424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:04.049120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:04.049571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:04.050016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:04.077826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:54:04.084532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.compute.api [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Working on deleting snapshot d19116aa-8e16-45c8-8050-d889c2d4948d from shelved instance... Oct 15 08:54:04.679298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Doing local delete in cell a0b25d10-5217-4459-9654-b7e7b9f4e0c0(cell1) {{(pid=125329) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 15 08:54:04.679993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:04.680462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:04.680888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:04.681301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.compute.api [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 15 08:54:04.684971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] deallocate_for_instance() {{(pid=125329) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 15 08:54:05.556713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4919f4-824b-4aec-8131-eabe4e8995df", "name": "network-vif-deleted", "tag": "3717c011-fe4a-413f-b1ef-15aff3def419"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:05.562122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Updating instance_info_cache with network_info: [] {{(pid=125329) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 15 08:54:05.570812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:05.571607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:05.572274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:05.586453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.compute.server_external_events [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] Unable to find a host for instance 5a4919f4-824b-4aec-8131-eabe4e8995df. Dropping event network-vif-deleted {{(pid=125327) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 15 08:54:05.587592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-1a469fa7-e7e0-4c82-82a5-a42f5558018d req-133758a8-cb99-45a0-bb60-24acdc3cff6d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.036702 Oct 15 08:54:05.588414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 407/811] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 15 08:54:05.774253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.scheduler.client.report [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Deleted allocations for instance 5a4919f4-824b-4aec-8131-eabe4e8995df Oct 15 08:54:05.907309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-25ce7b8a-839d-4fff-ba50-0ee62172df74 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 204 len: 0 microversion: 2.20 time: 1.871050 Oct 15 08:54:05.907895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 405/812] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Oct 15 08:54:04 2022] DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 0 bytes in 1872 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 08:54:05.916898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:05.917499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:05.923341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:05.923819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:05.924243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:05.924925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:05.925370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:05.925811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:05.939682 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df HTTP/1.1 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:54:05.941383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 08:54:05.943397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '5a4919f4-824b-4aec-8131-eabe4e8995df'} Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:54:05.944358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 08:54:05.945929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:54:05.948097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:54:05.948097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d9bd892d-5ac5-4d60-b538-2faecc71a5c3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 404 len: 111 microversion: 2.20 time: 0.029855 Oct 15 08:54:05.948097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 408/813] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:05 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 08:54:05.952953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bdac7af0-8468-47ba-a130-0f9ff86f35fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '.version_select at 0x7f575ad689d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:05.973157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bdac7af0-8468-47ba-a130-0f9ff86f35fd tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-882221769" status: 204 len: 0 microversion: 2.20 time: 0.024544 Oct 15 08:54:05.974424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 406/814] 10.222.0.30 () {60 vars in 1259 bytes} [Sat Oct 15 08:54:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-882221769 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 08:54:06.689865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-818dc2cd-d761-43e8-b1b8-f0e6bd854d7d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'create', calling method: .version_select at 0x7f575e585af0>, body: {"keypair": {"name": "tempest-keypair-324521777", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfuDlWHnPoCDD0lJTFSJj1bLFdhQOqHZPAmnczkWPnsF/nYpKIoUesRVh8dyQO8oPzmwMTszpbrpbsvyz+8R3Jy7QWdBgQYWUe2FRXFt1mdb3HZ6j70mmNRELSW9SnHlA=="}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:06.711911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-818dc2cd-d761-43e8-b1b8-f0e6bd854d7d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for project 23e3a95b1487450cad043a820d321f26. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:54:06.715863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-818dc2cd-d761-43e8-b1b8-f0e6bd854d7d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for user 388ca829d87348bd9b524fd9a80e578b and project 23e3a95b1487450cad043a820d321f26. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:54:06.741769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-818dc2cd-d761-43e8-b1b8-f0e6bd854d7d tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.056337 Oct 15 08:54:06.742443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 409/815] 10.222.0.30 () {62 vars in 1200 bytes} [Sat Oct 15 08:54:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 58 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 15 08:54:07.995988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1297949324", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ea53bcc8-72ba-43b3-b5ba-25a7a79f0091"}], "security_groups": [{"name": "tempest-securitygroup--1071256987"}], "key_name": "tempest-keypair-324521777", "user_data": "}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:08.004349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:08.099243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] validate_networks() for [('ea53bcc8-72ba-43b3-b5ba-25a7a79f0091', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:54:08.463165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:54:08.463588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:54:08.464061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:54:08.464497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:54:08.464906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:54:08.473598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:08.474178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:08.474613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:08.475341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:08.475796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:08.476246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:08.492414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for project 23e3a95b1487450cad043a820d321f26. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:54:08.496321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Getting quotas for user 388ca829d87348bd9b524fd9a80e578b and project 23e3a95b1487450cad043a820d321f26. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:54:08.507565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:54:08.509917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:54:08.555732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e509d783-df2c-4cf9-9110-b65b4eef6499 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564169 Oct 15 08:54:08.556372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 407/816] 10.222.0.30 () {62 vars in 1188 bytes} [Sat Oct 15 08:54:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 15 08:54:08.568634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:08.569242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:08.620931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:08.628098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:08.630090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:08.631369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3f34c4f-aeac-48e2-91d8-9c869a1bb9a7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1281 microversion: 2.20 time: 0.067597 Oct 15 08:54:08.631902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 410/817] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:08 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:09.657782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:09.658410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:09.665929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:09.667154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:09.667749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:09.668642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:09.668980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:09.669454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:09.736267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:09.744740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:09.746227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:09.747350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a439ff6d-a936-4355-a0eb-6bc60f569895 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1341 microversion: 2.20 time: 0.094656 Oct 15 08:54:09.747892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 408/818] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:09 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1341 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:10.773107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:10.773666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:10.776991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:10.781432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:10.781933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:10.782362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:10.783048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:10.783496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:10.783913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:10.982268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:10.991171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:10.992602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:10.993770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-12e55fb7-33b2-40c8-8cf5-9c2bd4db33ca tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.225195 Oct 15 08:54:10.994485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 411/819] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:10 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:11.057371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f95b72-8aed-4cf1-9d99-e9a96e09e797", "tag": "694e5f8f-4497-4c10-84f4-ad5add1f1bb2"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:11.067869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:11.069046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:11.069716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:11.080997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] Creating event network-changed:694e5f8f-4497-4c10-84f4-ad5add1f1bb2 for instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 on hv-cinder-85697 Oct 15 08:54:11.086054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-efca6320-520b-4e9f-8f22-fb631277c791 req-ff9b6dfe-4d79-4f0c-95bc-af61457e63a4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032982 Oct 15 08:54:11.086651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 409/820] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:12.019732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:12.020332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:12.027312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:12.027786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:12.028213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:12.028892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:12.029339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:12.029780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:12.154988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:12.163400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:12.164835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:12.165961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-88d41def-b1ba-40a3-80f6-ecc2883c4358 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.150123 Oct 15 08:54:12.166507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 412/821] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:12 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:13.191094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:13.191792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:13.198573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:13.199053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:13.199486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:13.200168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:13.200621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:13.201046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:13.332423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:13.340395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:13.341895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:13.342993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c616bac1-d22c-4af4-a7f1-ee1d8f982a45 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.156698 Oct 15 08:54:13.343540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 410/822] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:13 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:14.367439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:14.368044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:14.374413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:14.374891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:14.375323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:14.376011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:14.376461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:14.376883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:14.500880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:14.509128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:14.510590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:14.511687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ab6d878b-f84b-4e7f-bcc7-be94605b3039 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.148738 Oct 15 08:54:14.512453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 413/823] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:14 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:15.536650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:15.537920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:15.544469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:15.544956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:15.545394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:15.546120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:15.546579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:15.547007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:15.700753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f95b72-8aed-4cf1-9d99-e9a96e09e797", "name": "network-vif-plugged", "status": "completed", "tag": "694e5f8f-4497-4c10-84f4-ad5add1f1bb2"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:15.712931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:15.713473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:15.714125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:15.715982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:15.727954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] Creating event network-vif-plugged:694e5f8f-4497-4c10-84f4-ad5add1f1bb2 for instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 on hv-cinder-85697 Oct 15 08:54:15.731144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:15.732615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:15.733998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0d07c333-38e0-42d8-a82d-53f0be305b2e tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.201262 Oct 15 08:54:15.735023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 411/824] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:15 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:15.748785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-93f62570-085e-447f-a8f4-2f31b2cef5ef req-0574aaab-a706-4136-ba1e-d3d3e536686c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051660 Oct 15 08:54:15.749455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 414/825] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:16.759972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:16.760655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:16.767311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:16.767863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:16.768475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:16.769174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:16.769632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:16.770091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:16.897347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:16.905325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:16.906792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:16.907884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6efa2fc8-4d62-4312-9521-d43b8a83fba8 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1407 microversion: 2.20 time: 0.151771 Oct 15 08:54:16.908435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 412/826] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:16 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:17.934522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:17.935173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:17.941210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:17.941710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:17.942146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:17.942824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:17.943939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:17.944363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:18.078176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:18.086221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:18.087642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:54:18.088773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fe0318b2-0339-4102-b7c4-d0577e501933 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1598 microversion: 2.20 time: 0.159232 Oct 15 08:54:18.089324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 415/827] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 08:54:17 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 08:54:18.113554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:18.114123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:18.120903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:18.121374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:18.121831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:18.122531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:18.122977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:18.123391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:18.127097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=20,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:18.200326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e8c55049-603c-4f0b-9ad0-51b1fcd54a3b tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.090545 Oct 15 08:54:18.200923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 413/828] 10.222.0.30 () {60 vars in 1316 bytes} [Sat Oct 15 08:54:18 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:54:19.101960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29f95b72-8aed-4cf1-9d99-e9a96e09e797", "tag": "694e5f8f-4497-4c10-84f4-ad5add1f1bb2"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:54:19.106798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=6 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:19.112972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:19.113440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:19.113901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:19.125614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] Creating event network-changed:694e5f8f-4497-4c10-84f4-ad5add1f1bb2 for instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 on hv-cinder-85697 Oct 15 08:54:19.130913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-d97d0bf4-d853-489b-9cb1-b240ac02d06b req-7b562bcd-ea68-4a47-b8ed-c1d8c8f06992 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033119 Oct 15 08:54:19.131936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 416/829] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:31.560812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:31.561559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:31.562897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:31.563707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:31.568065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:31.570288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:31.578475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:31.579048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:31.579482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:31.580171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:31.580622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:31.581049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:31.610938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3df6fbbc-1855-4b87-bc77-42946afb3bab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Oct 15 08:54:31.611497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 414/830] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:32.624773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:32.626994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:32.629449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=11 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:32.645250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=37 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:54:32.645250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:32.645250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:32.645250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:32.645605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:32.645605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:32.645605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:32.674139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c1a44dc4-44bc-40c0-b3f8-4efa5aab23da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053657 Oct 15 08:54:32.674687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 417/831] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:33.814256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:33.816435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:33.822864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:33.823337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:33.823764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:33.824438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:33.824937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:33.825304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:33.854114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-431e4a70-1b6f-475d-abee-43fb7d9199b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171513 Oct 15 08:54:33.854654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 415/832] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:34.866263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:34.868396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:34.874791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:34.875274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:34.875712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:34.876398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:34.876904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:34.877282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:34.906724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-759110a4-c248-420b-b39e-c895ea245b75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Oct 15 08:54:34.907252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 418/833] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:35.919629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:35.921824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:35.928142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:35.928620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:35.929051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:35.929885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:35.930296 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:35.930718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:35.958948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b6bf56c5-8228-4d74-bcc3-930d5e2cf473 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043335 Oct 15 08:54:35.960024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 416/834] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:36.971642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:36.973787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:36.979797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:36.980272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:36.980764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:36.981388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:36.981883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:36.982302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:37.011251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2c3d6c68-bcec-487d-8554-9d114bce1a5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043506 Oct 15 08:54:37.011794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 419/835] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:38.024141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:38.026343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:38.032310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:38.032792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:38.033223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:38.034127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:38.034631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:38.035274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:38.065597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-87c873cf-b7c8-4244-a187-cea3160212bc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Oct 15 08:54:38.066181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 417/836] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:39.078442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:39.080581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:39.087746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:39.088163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:39.088593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:39.089266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:39.089735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:39.090153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:39.118283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-20acf766-8ffa-469b-903f-81c28f5fd8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Oct 15 08:54:39.118813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 420/837] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:40.130726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:40.133425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:40.139871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:40.140294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:40.140730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:40.141416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:40.141900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:40.142325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:40.171701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-03264039-a379-4bd3-a563-1a93db7d0f8d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044981 Oct 15 08:54:40.172237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 418/838] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:41.198631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:41.198631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:41.198631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:41.198631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:41.199275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:41.199275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:41.199275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:41.199275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:41.232509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3cc014c3-ee0b-46f8-a211-b3d550b82512 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052137 Oct 15 08:54:41.233144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 421/839] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:42.245722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:42.247861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:42.254292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:42.254770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:42.255196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:42.255875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:42.256322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:42.256764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:42.286563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-13a1df9e-824e-42c4-8ee1-290806f645df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Oct 15 08:54:42.287242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 419/840] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:43.299425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:43.301719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:43.308397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:43.308879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:43.309325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:43.310062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:43.310514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:43.310937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:43.340683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3cea7b26-8777-4aa5-98c0-832f9ea3ba36 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Oct 15 08:54:43.341220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 422/841] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:44.352784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:44.354994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:44.361400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:44.361916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:44.362366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:44.363080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:44.363534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:44.363961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:44.394811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0ce5bcb8-f039-4f83-98b9-8dd9853a9798 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Oct 15 08:54:44.395598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 420/842] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:45.407178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:45.409318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:45.415869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:45.416353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:45.416793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:45.417487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:45.417984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:45.418437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:45.449002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a90600da-40d9-490d-82da-81e9544e9d0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Oct 15 08:54:45.449625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 423/843] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:46.460804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:46.463020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:46.469393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:46.469923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:46.470363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:46.471060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:46.471516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:46.471941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:46.501828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-058506ba-c805-4c94-9cef-b0e66ce199cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Oct 15 08:54:46.502384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 421/844] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:47.514606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:47.516746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:47.524200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:47.524680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:47.525108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:47.525830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:47.526283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:47.526703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:47.556412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-55805f4a-bffd-4e38-ad5f-bb280aff8c70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Oct 15 08:54:47.557035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 424/845] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:48.568305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:48.570600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:48.576935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:48.577422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:48.577902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:48.578596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:48.579054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:48.579561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:48.609597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e08b0921-9d20-4344-a9b9-d25f90190495 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Oct 15 08:54:48.610242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 422/846] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:49.622459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:49.624560 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:49.630827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:49.631302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:49.631730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:49.632407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:49.632849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:49.633263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:49.664059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f7bec010-bccf-4502-85af-46daf4e1d301 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Oct 15 08:54:49.664630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 425/847] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:50.676023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:50.678187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:50.684866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:50.685332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:50.685794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:50.686496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:50.687252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:50.687375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:50.718032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9f108225-208f-4784-9cf5-65a4604bde63 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Oct 15 08:54:50.718589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 423/848] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:51.730017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:51.732170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:51.738498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:51.738983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:51.739414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:51.740408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:51.740553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:51.740978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:51.771153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-14e754eb-0e36-4736-9f10-ebfed999dad7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045049 Oct 15 08:54:51.771697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 426/849] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:52.783178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:52.785575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:52.792115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:52.792607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:52.793041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:52.793755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:52.794218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:52.794642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:52.823952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-52a69738-b18b-4c3a-993e-52619a1178f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Oct 15 08:54:52.824503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 424/850] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:53.836847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:53.839017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:53.845411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:53.845902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:53.846327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:53.847094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:53.847538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:53.847954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:53.878614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2ece409-851e-44a4-b5aa-6717ed199f99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046312 Oct 15 08:54:53.879146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 427/851] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:53.996419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:53.996941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:54.002813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:54.003288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:54.003714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:54.004398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:54.004844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:54.005284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:54.028990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bf2dcebb-f5e8-42ea-8bbf-16a1f488474a tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797/ips" status: 200 len: 151 microversion: 2.20 time: 0.115923 Oct 15 08:54:54.029523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 425/852] 10.222.0.30 () {60 vars in 1289 bytes} [Sat Oct 15 08:54:53 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797/ips => generated 151 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 08:54:54.891192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:54.893401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:54.900396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:54.900879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:54.901313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:54.902061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:54.902516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:54.902941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:54.932455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f1a0136d-7433-4bf7-9bb0-7bfd4de00c0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Oct 15 08:54:54.932993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 428/853] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:55.944309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:55.946468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:55.952771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:55.953236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:55.953666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:55.954382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:55.954830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:55.955272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:55.985012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-00295907-26cd-4bb7-a884-7628b07be11d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Oct 15 08:54:55.985560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 426/854] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:56.996381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:56.998543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:57.004551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:57.005025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:57.005452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:57.006162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:57.006607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:57.007025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:57.037124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a8cc43a0-43ba-4bc2-8944-f2f8acab47d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Oct 15 08:54:57.037661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 429/855] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:58.050022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:58.052206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:58.059438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:58.059926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:58.064031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:58.065245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:58.065741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:58.066183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:58.095348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-21e32a28-ba52-4f92-8d40-1909424d493d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049284 Oct 15 08:54:58.095901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 427/856] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:54:59.107429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:54:59.109569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:54:59.115908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:59.116386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:59.117359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:59.118120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:54:59.118572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:54:59.118976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:54:59.147982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6dfab5e1-8619-4a73-89ab-3ffdc5cbca1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Oct 15 08:54:59.148515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 430/857] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:54:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:00.160531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:00.162754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:00.169116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:00.169602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:00.170088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:00.170776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:00.171233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:00.171659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:00.201221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cd9837fa-f7ea-4331-a99f-640f018900c9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Oct 15 08:55:00.201842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 428/858] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:01.214301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:01.216380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:01.222802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:01.223294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:01.223751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:01.224421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:01.224880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:01.225307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:01.255407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d0249636-bf39-4a5d-b28c-82d0f998b48e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Oct 15 08:55:01.255966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 431/859] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:02.267729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:02.269959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:02.272241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=31 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:02.277578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:02.278094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:02.278530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:02.279220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:02.279675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:02.280101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:02.282621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=89 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:02.311167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d8130656-e10b-4b07-8a37-62d901fc9730 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Oct 15 08:55:02.311719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 429/860] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:03.324951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:03.327153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:03.329023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=31 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:03.334414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:03.334895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:03.335321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:03.336614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:03.337060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:03.337475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:03.340002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=91 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:03.367845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b5bdae96-71ab-4e02-a479-58df55b19e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048212 Oct 15 08:55:03.368383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 432/861] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:04.379169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:04.381291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:04.388363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:04.388844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:04.389273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:04.389991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:04.390446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:04.390863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:04.419959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2e9cc034-b25c-4ea2-9a36-6ff3ff6bf964 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Oct 15 08:55:04.420512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 430/862] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:05.433001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:05.435186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:05.441818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:05.442295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:05.442724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:05.443396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:05.443843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:05.444259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:05.472634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2bd64d13-caff-4208-b904-1e74d1ae71cf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Oct 15 08:55:05.473171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 433/863] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:06.484326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:06.486537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:06.493328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:06.493840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:06.494269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:06.494949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:06.495396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:06.495813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:06.524470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-28e31c81-c938-47a7-beb5-30526cc57e66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044071 Oct 15 08:55:06.525008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 431/864] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:07.536682 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:07.539339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:07.545468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:07.546035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:07.546468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:07.547155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:07.547602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:07.548023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:07.577249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ece3ea8f-411a-458e-a2c6-d4c8d9038c92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Oct 15 08:55:07.577826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 434/865] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:08.589830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:08.592152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:08.598367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:08.598924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:08.599419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:08.600171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:08.600687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:08.601245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:08.630427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e21009b4-d789-4b50-b6df-a4e661db8bdf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Oct 15 08:55:08.630972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 432/866] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:09.643297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:09.645522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:09.652613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:09.653048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:09.653485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:09.654199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:09.654662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:09.655084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:09.684370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-993e30bf-2a73-4edd-91a0-6d6af0755e55 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Oct 15 08:55:09.684906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 435/867] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:10.696987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:10.699135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:10.705453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:10.705965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:10.706398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:10.707074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:10.707523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:10.707937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:10.736819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-38616bf4-3e8a-4f05-8155-4beb10abec67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Oct 15 08:55:10.737347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 433/868] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:11.748256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:11.750415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:11.756584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:11.757056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:11.757627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:11.758327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:11.758773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:11.759189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:11.788139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-357115c5-7896-4304-aa85-1802926cac45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Oct 15 08:55:11.789281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 436/869] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:12.800246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:12.802409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:12.809486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:12.810003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:12.810439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:12.811176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:12.811634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:12.812060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:12.840563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-64bb8ae1-6748-4952-94a3-0953f783c861 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Oct 15 08:55:12.841097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 434/870] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:13.852526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:13.854799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:13.861217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:13.861720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:13.862152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:13.862841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:13.863281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:13.863703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:13.893929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-61fda384-61fb-4a84-b3cd-c7fe68ebf904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045430 Oct 15 08:55:13.894469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 437/871] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:14.905962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:14.908202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:14.915393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:14.915869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:14.916301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:14.916981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:14.917428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:14.917892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:14.946700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c639d8b7-999a-45b8-a835-00532bff37d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Oct 15 08:55:14.947244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 435/872] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:15.958844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:15.961048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:15.967504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:15.968006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:15.968441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:15.969124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:15.969575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:15.970020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:16.000247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4138c042-e152-41d5-8269-f0977c0e01ea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Oct 15 08:55:16.000788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 438/873] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:17.012920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:17.015137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:17.021820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:17.022311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:17.022769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:17.023466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:17.023914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:17.024340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:17.055064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c062603b-02af-45c3-9301-8962ee53c79a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046000 Oct 15 08:55:17.055792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 436/874] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:18.067254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:18.069391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:18.076314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:18.076804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:18.077235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:18.077945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:18.078398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:18.078818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:18.107957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-72a1a952-0e00-40f1-aa8b-9a9831b8ce0a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044670 Oct 15 08:55:18.108491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 439/875] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:19.120186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:19.122362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:19.128632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:19.129109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:19.129537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:19.130255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:19.130704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:19.131127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:19.159936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46f7f6b8-5fc9-47c1-aebd-4ffc6f02705f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Oct 15 08:55:19.160410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 437/876] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:20.172474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:20.174652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:20.180995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:20.181501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:20.182037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:20.182725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:20.183173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:20.183593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:20.212701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-05d697a0-519d-4815-bd1b-d11c68635df1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Oct 15 08:55:20.213257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 440/877] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:21.224350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:21.227055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:21.233390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:21.233909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:21.234349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:21.235040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:21.235497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:21.235921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:21.265155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1949c074-230d-4eff-9a43-bc428f88e669 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Oct 15 08:55:21.265716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 438/878] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:22.276727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:22.278935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:22.285150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:22.285622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:22.286334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:22.287013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:22.287460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:22.287876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:22.316877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dd4569fa-c6b6-4e52-9e91-c78e5a3e23dd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044434 Oct 15 08:55:22.317348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 441/879] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:23.329055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:23.331232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:23.337787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:23.338277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:23.338709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:23.339391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:23.339844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:23.340268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:23.369984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-29540306-0621-46a0-b681-d4b6f2e7c5c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Oct 15 08:55:23.370529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 439/880] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:24.382246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:24.384429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:24.390848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:24.391333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:24.391766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:24.392457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:24.392912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:24.393365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:24.423620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e74fffdd-3aeb-41f0-94e1-7703fd5f636a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045281 Oct 15 08:55:24.424164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 442/881] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:25.435670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:25.437897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:25.444435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:25.444993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:25.445449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:25.446155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:25.446616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:25.447044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:25.476597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a7cc6101-c0cd-41e2-abe7-d56c642ec652 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044293 Oct 15 08:55:25.477139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 440/882] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:26.488174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:26.490338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:26.496729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:26.497211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:26.497639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:26.498348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:26.498800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:26.499219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:26.529230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-307a6a3a-44b4-4595-99eb-88bb06e8a96e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044887 Oct 15 08:55:26.529794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 443/883] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:27.541023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:27.543188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:27.549520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:27.550035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:27.550463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:27.551137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:27.551584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:27.552002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:27.581460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-de91c73d-cd0f-4dc1-9dd2-468be5574296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044387 Oct 15 08:55:27.582016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 441/884] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:28.593981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:28.596148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:28.602573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:28.603052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:28.603484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:28.604164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:28.604613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:28.605030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:28.633997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9f5d105b-0e60-43ea-8d39-a80adace7c0c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Oct 15 08:55:28.634537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 444/885] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:29.646148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:29.648337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:29.654702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:29.655177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:29.655606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:29.656279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:29.656727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:29.657141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:29.686541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4873349c-ae2a-4aaf-82f5-9cae67f65ee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Oct 15 08:55:29.687081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 442/886] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:30.698772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:30.700911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:30.707258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:30.707742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:30.708170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:30.708848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:30.709296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:30.709737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:30.739039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-243df82a-a777-45bf-88a8-0759cec359bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Oct 15 08:55:30.739571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 445/887] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:31.751142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:31.753304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:31.760243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:31.760725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:31.761163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:31.761883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:31.762338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:31.762760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:31.791972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ccab8573-f720-40be-a4d2-863a76fc2604 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Oct 15 08:55:31.792512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 443/888] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:32.803460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:32.805630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:32.811961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:32.812439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:32.812869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:32.813552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:32.814030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:32.814457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:32.843136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2e00a542-b410-4d08-8977-cc2ba9e181e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043622 Oct 15 08:55:32.843670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 446/889] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:33.856017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:33.858211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:33.860496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:33.865783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:33.866893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:33.867335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:33.868029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:33.868489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:33.868915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:33.872667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:33.897759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-722e1f41-ec9a-4aa3-b08a-0e1b674ff1e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045682 Oct 15 08:55:33.898305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 444/890] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:34.909916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:34.912326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:34.914646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:34.920199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:34.920702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:34.921140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:34.921880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:34.922335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:34.922759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:34.925417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:55:34.954053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b182b1b2-b8e7-4a53-9c89-9110d5283c82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Oct 15 08:55:34.954628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 447/891] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:35.966742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:35.968895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:35.975297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:35.975774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:35.976222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:35.977519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:35.977993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:35.978414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:36.006743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-014369d1-25fc-4502-bf72-6805f21d1010 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Oct 15 08:55:36.007278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 445/892] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:37.019245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:37.021363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:37.027944 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:37.028419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:37.028847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:37.029518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:37.029994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:37.030412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:37.058724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-107fbd7a-8a4e-45d2-925e-d47c3146a397 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Oct 15 08:55:37.059257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 448/893] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:38.071123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:38.073571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:38.079942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:38.080427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:38.080864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:38.081559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:38.082043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:38.082487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:38.112535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-16214546-8c5b-40b2-97d1-04d68c5c1a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Oct 15 08:55:38.113098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 446/894] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:39.124303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:39.126489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:39.132826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:39.133306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:39.133769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:39.134449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:39.134898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:39.135316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:39.165022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a1856203-2162-4c1b-94b6-44d7226db5f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Oct 15 08:55:39.165564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 449/895] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:40.177065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:40.179197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:40.186742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:40.187216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:40.187643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:40.188320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:40.188765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:40.189183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:40.219430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-50ccbca6-3be3-4e31-ac91-91c1c9169dce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Oct 15 08:55:40.220005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 447/896] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:41.232217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:41.234379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:41.240612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:41.241089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:41.241524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:41.242291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:41.242759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:41.243181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:41.272311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-766629f6-1644-468c-b83d-63926efc6896 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Oct 15 08:55:41.272851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 450/897] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:42.284286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:42.286761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:42.293103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:42.293579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:42.294038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:42.294713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:42.295159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:42.295579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:42.324656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-82032509-6adf-493b-ac03-3aab7db7a35f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Oct 15 08:55:42.325204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 448/898] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:43.338779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:43.341321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:43.347686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:43.348159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:43.348586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:43.349268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:43.349731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:43.350150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:43.379549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7ea19f8a-0f93-4be4-974a-ed03d62d1ef6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046646 Oct 15 08:55:43.380084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 451/899] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:44.392089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:44.394215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:44.401234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:44.401736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:44.402169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:44.402851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:44.403302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:44.403718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:44.432299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fb481d5e-0207-4670-9b6e-aca7d054f663 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Oct 15 08:55:44.432844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 449/900] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:45.446596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:45.448742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:45.455541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:45.456022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:45.456455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:45.457162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:45.457614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:45.458072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:45.487821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8a0aeb2-9c73-4845-bd3d-4d52a4043298 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Oct 15 08:55:45.488361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 452/901] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:46.500200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:46.502456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:46.509341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:46.509848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:46.510281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:46.510956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:46.511403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:46.511821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:46.541412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5a1e2b42-f29c-4673-aeb6-20dc0b516480 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Oct 15 08:55:46.541978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 450/902] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:47.553605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:47.556340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:47.562954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:47.563430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:47.563888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:47.564566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:47.565012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:47.565428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:47.594218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-53885750-6552-4399-b03d-77c542ea3a4a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Oct 15 08:55:47.594753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 453/903] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:48.606467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:48.608580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:48.614948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:48.615422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:48.615858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:48.616530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:48.617489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:48.617936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:48.647638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-72e83e81-e333-4631-ab41-be16fe0ffd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045152 Oct 15 08:55:48.648192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 451/904] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:49.659982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:49.662451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:49.668869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:49.669347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:49.669811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:49.670491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:49.670943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:49.671363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:49.700125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f0d017b-70ab-4b26-992b-add2819773a1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Oct 15 08:55:49.700658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 454/905] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:55:50.712312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:50.714447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:50.720784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:50.721260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:50.721702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:50.722387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:50.722834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:50.723250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:50.752531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86a57431-b8c3-4661-aed1-9a434790a754 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Oct 15 08:55:50.753066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 452/906] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:51.764578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:51.766740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:51.772958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:51.773437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:51.773996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:51.774681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:51.775136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:51.775556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:51.804707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-241397ce-1070-4a36-b052-a68214327eea tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Oct 15 08:55:51.805810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 455/907] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:52.817514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:52.819722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:52.826729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:52.827215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:52.827679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:52.828367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:52.828823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:52.829248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:52.857835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-28ea9300-3ebc-4ebd-825f-908c2c1103b9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Oct 15 08:55:52.858378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 453/908] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:53.870694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:53.872748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:53.879005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:53.879482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:53.879910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:53.880585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:53.881028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:53.881445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:53.909953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-80f9f06e-3b00-45cf-b48c-648118464d89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Oct 15 08:55:53.910486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 456/909] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:54.921596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:54.923768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:54.930237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:54.930666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:54.931102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:54.931792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:54.932248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:54.932671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:54.962490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8dcf1aa5-71f5-4e4b-9b75-d85c1825f909 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Oct 15 08:55:54.963049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 454/910] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:55.974732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:55.976898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:55.983183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:55.983661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:55.984094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:55.984765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:55.985209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:55.985623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:56.014977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a514ec55-e557-4318-835f-b193cbcf2658 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Oct 15 08:55:56.015505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 457/911] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:57.027447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:57.029576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:57.036356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:57.036834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:57.037264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:57.037991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:57.038442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:57.038863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:57.067338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86b1a7eb-3c74-4707-98e4-9b3a0d6e7008 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Oct 15 08:55:57.067810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 455/912] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:58.079605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:58.081768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:58.088451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:58.088938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:58.089367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:58.090093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:58.090545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:58.090966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:58.120308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-463f1b06-52d7-430a-90f8-d714f3c96043 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Oct 15 08:55:58.120779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 458/913] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:55:59.132455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:55:59.135277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:55:59.141623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:59.142125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:59.142550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:59.143233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:55:59.143679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:55:59.144096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:55:59.173003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d77a9b71-6d6e-42be-8746-4cd6b0541ca6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Oct 15 08:55:59.173535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 456/914] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:55:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:00.184431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:00.186619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:00.192927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:00.193405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:00.193882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:00.194568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:00.195023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:00.195446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:00.224866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2c105553-3f6a-4383-a1e3-b81f9356fd11 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044359 Oct 15 08:56:00.225339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 459/915] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:01.237062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:01.239233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:01.245640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:01.246156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:01.246595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:01.247285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:01.247740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:01.248167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:01.277459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4cda1a71-4311-41bf-9460-3986539a2497 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Oct 15 08:56:01.278042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 457/916] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:02.290073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:02.292744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:02.299004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:02.299484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:02.299918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:02.300605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:02.301056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:02.301475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:02.332613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-882822c5-5883-43ce-97d1-52e74439da6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046710 Oct 15 08:56:02.333172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 460/917] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:03.345639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:03.348066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:03.355035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:03.355523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:03.355977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:03.356703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:03.357163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:03.357590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:03.390252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2281a102-6ce8-4a39-8b19-44b2df8665c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Oct 15 08:56:03.391598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 458/918] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:04.403704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:04.405929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:04.412671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:04.413155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:04.413587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:04.414302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:04.414756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:04.415182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:04.446159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e18cd859-eb7e-4616-9fc4-bca92dac2a82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046776 Oct 15 08:56:04.446763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 461/919] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:05.463030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:05.465269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:05.467585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:05.472626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:05.473107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:05.473536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:05.474276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:05.474726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:05.476452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:05.480187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:05.508027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b6051309-1d69-4eb1-8b85-eaaf4c8e658e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048922 Oct 15 08:56:05.508593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 459/920] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:06.520432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:06.522590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:06.524414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:06.529962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:06.530451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:06.530882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:06.531568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:06.532016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:06.532434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:06.536498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:06.573157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-80e9e63c-f503-45c8-acf2-0ef6464b89df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056730 Oct 15 08:56:06.573739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 462/921] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:07.587770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:07.589972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:07.596135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:07.596615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:07.597043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:07.597783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:07.598238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:07.598661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:07.628315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c42b2276-e65e-4bbe-a1ae-18f4eda50eba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Oct 15 08:56:07.628880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 460/922] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:08.640436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:08.642618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:08.649025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:08.650042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:08.650475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:08.651225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:08.651679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:08.652097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:08.682074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cf5e2690-c565-4da9-b519-2c6bc3ab37cd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Oct 15 08:56:08.682557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 463/923] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:09.698653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:09.700915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:09.707355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:09.707832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:09.708262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:09.708941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:09.709387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:09.709834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:09.739613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-395f4e67-e9da-4882-8e12-b29609c0d5d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Oct 15 08:56:09.740433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 461/924] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:10.752504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:10.754747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:10.761027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:10.761510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:10.761973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:10.762655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:10.763103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:10.763536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:10.794561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-390b2565-1dd0-4c74-b398-1fd060ddfc98 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Oct 15 08:56:10.795120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 464/925] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:11.807365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:11.809512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:11.815824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:11.816301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:11.816729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:11.817407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:11.817880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:11.818297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:11.848056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3f94e005-5865-45d1-8c9a-4cfde7073973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Oct 15 08:56:11.848610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 462/926] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:12.860398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:12.862707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:12.870453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:12.870940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:12.871377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:12.872099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:12.872553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:12.873129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:12.904223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f6b5baf4-4bdc-46ea-a702-dece7e12bbc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047880 Oct 15 08:56:12.904928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 465/927] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:13.917134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:13.919393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:13.925856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:13.926317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:13.926749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:13.927444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:13.927903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:13.928325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:13.970594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aaf12bf1-f085-4179-90f9-f632e58756d7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057789 Oct 15 08:56:13.971012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 463/928] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:14.982750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:14.984965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:14.991098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:14.991582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:14.992017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:14.992703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:14.993216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:14.993658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:15.030816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d5459d40-1cfd-424c-b181-e9b0b765367f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052017 Oct 15 08:56:15.031445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 466/929] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:16.045407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:16.047589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:16.053976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:16.054459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:16.054891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:16.055608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:16.056061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:16.056509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:16.086350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-133854e6-68d7-4f94-a478-13e76b5d3062 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046997 Oct 15 08:56:16.087480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 464/930] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:17.099215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:17.101389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:17.108440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:17.108926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:17.109366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:17.110094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:17.110547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:17.110968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:17.143914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f781bfe-fe5e-4a90-9857-af7136f1b593 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048535 Oct 15 08:56:17.144471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 467/931] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:18.156275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:18.160329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:18.167160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:18.167649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:18.168088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:18.168788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:18.169251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:18.169696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:18.200399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f114aa00-29b9-48fd-ba5e-774558f6dee0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048009 Oct 15 08:56:18.205012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 465/932] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:19.212812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:19.215027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:19.217543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:56:19.217729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:56:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments (ip 10.222.0.30) !!! Oct 15 08:56:19.224017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:19.224512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:19.224947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:19.225637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:19.226121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:19.226544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:19.260708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d258819a-ed9f-46ea-a15c-3beb54c585d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052380 Oct 15 08:56:19.261261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 468/933] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:20.272509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:20.274996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:20.281396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:20.281973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:20.282458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:20.283176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:20.283626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:20.284040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:20.316976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-976ef9f8-2b30-4f63-adb2-6173bd71037b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048333 Oct 15 08:56:20.317939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 466/934] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:21.328514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:21.331334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:21.337603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:21.338118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:21.338559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:21.339231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:21.339680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:21.340094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:21.369745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dd3edb2f-990e-4476-a022-5a1fa6a8f119 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Oct 15 08:56:21.370446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 469/935] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:22.382463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:22.384616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:22.391573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:22.392134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:22.392636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:22.393336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:22.393814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:22.394494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:22.431003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a90eb4a6-b995-44b7-a492-2551e050fd67 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052577 Oct 15 08:56:22.431644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 467/936] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:23.444028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:23.446246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:23.452520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:23.452997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:23.453429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:23.454137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:23.454665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:23.455062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:23.487466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dad05d97-59b9-4bc9-9057-5337f957f455 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047787 Oct 15 08:56:23.488178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 470/937] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:24.499664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:24.501886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:24.508225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:24.508744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:24.509200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:24.509913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:24.510365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:24.510787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:24.543832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-feb3589d-d581-438f-bb2e-a7fc63a23083 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Oct 15 08:56:24.544398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 468/938] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:25.557125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:25.559305 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:25.565608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:25.567699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:25.568137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:25.568838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:25.569297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:25.569742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:25.599705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8d47b58-07d7-405e-94e0-97076c9536c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Oct 15 08:56:25.600257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 471/939] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:26.612287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:26.614478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:26.620722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:26.621201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:26.621630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:26.622352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:26.622801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:26.623224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:26.653096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4f583e2f-327f-4293-b810-40679bb04797 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044685 Oct 15 08:56:26.653653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 469/940] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:27.666077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:27.668325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:27.670712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:56:27.670858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments (ip 10.222.0.30) !!! Oct 15 08:56:27.676644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:27.677128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:27.677561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:27.678306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:27.678759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:27.679182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:27.711083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-72432cb3-f227-401c-8e7e-18521ba3383f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049470 Oct 15 08:56:27.711649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 472/941] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:28.723595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:28.725747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:28.732730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:28.733210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:28.733640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:28.734354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:28.734844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:28.735267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:28.765587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b4162a73-be14-48ab-a0ac-f2cfb50fe1be tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045957 Oct 15 08:56:28.766356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 470/942] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:56:29.778766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:29.780961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:29.787661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:29.788140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:29.788573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:29.789875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:29.790327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:29.790750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:29.819896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7167c859-ac1b-43c2-b985-928b8209d30c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044943 Oct 15 08:56:29.820661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 473/943] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:56:30.832357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:30.834496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:30.842057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:30.842537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:30.842965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:30.843649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:30.844098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:30.844514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:30.876363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b6306c4a-219d-4291-9f04-e11bae1d1ba9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048022 Oct 15 08:56:30.880870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 471/944] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:31.888689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:31.890857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:31.896980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:31.897469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:31.897916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:31.898602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:31.899050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:31.899486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:31.928268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-136a5b71-3f85-4174-993e-b73deaf168ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Oct 15 08:56:31.929006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 474/945] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:32.941153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:32.943246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:32.949570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:32.950074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:32.950505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:32.951705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:32.951705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:32.952045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:32.981338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-51c4a098-851d-4bb4-8c59-6e99074fd1c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Oct 15 08:56:32.982178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 472/946] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:33.993817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:33.996125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:34.002440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:34.002922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:34.003348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:34.004020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:34.004467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:34.004883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:34.035267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2a7e330d-38e9-40c8-80fd-28784a490aa6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045480 Oct 15 08:56:34.036083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 475/947] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:35.048077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:35.050294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:35.057166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:35.057643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:35.058093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:35.058769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:35.059214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:35.059632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:35.089149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ce41f93a-a450-4e8d-93d2-92707c584183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045086 Oct 15 08:56:35.090041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 473/948] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:36.101724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:36.103878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:36.110216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:36.110691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:36.111117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:36.111791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:36.112337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:36.112761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:36.142842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef9ccd55-c870-46c2-ade4-53de5eeae50f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Oct 15 08:56:36.143410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 476/949] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:37.155281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:37.157465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:37.159498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:37.165768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:37.166252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:37.166685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:37.167367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:37.167819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:37.168241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:37.170760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:37.198362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ed213911-e5f2-4e63-afa7-1e4855be01f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047005 Oct 15 08:56:37.198919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 474/950] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:38.210748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:38.212872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:38.214868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:38.220045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:38.220523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:38.220949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:38.221627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:38.222097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:38.222539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:38.225027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:56:38.252927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3594905-80dc-4f38-8df2-badad85be226 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Oct 15 08:56:38.253472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 477/951] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:39.264392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:39.266594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:39.273551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:39.274281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:39.274711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:39.275421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:39.275872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:39.276318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:39.305792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8c7a25be-7089-4c7f-a7f0-3e94b7e967db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Oct 15 08:56:39.306331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 475/952] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:40.318544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:40.321216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:40.327620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:40.328100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:40.328525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:40.329203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:40.329703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:40.330130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:40.358398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-33f156a1-789e-45e7-ab04-c87282890837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Oct 15 08:56:40.358927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 478/953] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:41.370910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:41.372957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:41.379342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:41.379821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:41.380253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:41.380937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:41.381384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:41.381847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:41.412571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-27f8dc90-a6a4-4c9e-9aae-8278198606d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Oct 15 08:56:41.413132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 476/954] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:42.424395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:42.426617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:42.432920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:42.433399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:42.433875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:42.434556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:42.435010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:42.435431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:42.466373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aa7c2d03-ead1-4df2-a83a-1e9b0030a044 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Oct 15 08:56:42.466933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 479/955] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:43.479483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:43.481638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:43.488023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:43.488504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:43.488937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:43.489620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:43.490101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:43.490523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:43.520020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-762d026d-284d-4b23-a375-794596840c5f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045085 Oct 15 08:56:43.520584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 477/956] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:44.532736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:44.534894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:44.542166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:44.542649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:44.543087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:44.543775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:44.544228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:44.544653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:44.573091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9fab9f70-265e-4242-8331-004e2295ec2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Oct 15 08:56:44.573637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 480/957] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:45.585146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:45.587313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:45.593771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:45.594263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:45.594730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:45.595418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:45.595875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:45.596300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:45.625442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-be3b0b08-9ec6-4ebb-ae4c-34f8119939fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Oct 15 08:56:45.626013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 478/958] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:46.638450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:46.640613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:46.642597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:56:46.642732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:56:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments (ip 10.222.0.30) !!! Oct 15 08:56:46.650976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:46.651604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:46.652042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:46.652732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:46.653185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:46.653636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:46.685523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-56a57b04-1a9e-428d-a80b-5bfef5340c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051074 Oct 15 08:56:46.686103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 481/959] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:56:47.697953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:47.700064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:47.706455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:47.706932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:47.707360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:47.708067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:47.708520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:47.708939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:47.737386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ff6cdd81-9bfb-4d87-941f-0b711ac2cff9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Oct 15 08:56:47.738028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 479/960] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:48.750449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:48.752611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:48.759501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:48.759978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:48.760404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:48.761087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:48.761532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:48.761974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:48.792799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3f33e901-ac0e-4bed-84ca-5f7161317048 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046321 Oct 15 08:56:48.793357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 482/961] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:49.805532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:49.807651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:49.809587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:56:49.809755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 08:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments (ip 10.222.0.30) !!! Oct 15 08:56:49.815841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:49.816319 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:49.816746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:49.817426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:49.817927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:49.818346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:49.848652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1e88b373-7e64-43b4-9e0c-df2da6e5da75 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047613 Oct 15 08:56:49.849198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 480/962] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:50.860482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:50.862693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:50.869535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:50.870038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:50.870466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:50.871140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:50.871585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:50.872009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:50.900727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dc8b6fbf-3549-42bc-a68c-9f05e248b93f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Oct 15 08:56:50.901254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 483/963] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:56:51.914329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:51.916442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:51.922812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:51.923290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:51.923721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:51.924399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:51.924846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:51.925260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:51.955190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8583dd33-96b0-47b3-bae6-598a779028de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Oct 15 08:56:51.955728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 481/964] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:52.967493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:52.969622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:52.976016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:52.976494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:52.976925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:52.977598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:52.978068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:52.978489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:53.008300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ed67522c-c3b3-42f9-870d-e425ad6b4997 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Oct 15 08:56:53.008829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 484/965] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:54.020503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:54.023342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:54.029818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:54.030307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:54.030743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:54.031436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:54.031894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:54.032318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:54.061143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1ecdd7d9-9148-49ec-8f6c-d086fe3656af tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Oct 15 08:56:54.061696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 482/966] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:55.073514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:55.075694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:55.081985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:55.082461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:55.082885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:55.083562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:55.084015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:55.084441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:55.114564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-48ea08b3-6358-4c22-8f0b-e9e760801b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Oct 15 08:56:55.115331 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 485/967] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:56.126154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:56.128261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:56.134650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:56.135128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:56.135558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:56.136241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:56.136689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:56.137106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:56.166840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fb625d47-5b63-4c35-b783-1dd31232c6ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Oct 15 08:56:56.167381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 483/968] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:57.179332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:57.181461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:57.187800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:57.188279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:57.188725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:57.189482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:57.189995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:57.190437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:57.219604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8a85128c-626e-42c9-a0e3-d72fc4a82dc9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Oct 15 08:56:57.220237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 486/969] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:58.232076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:58.234227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:58.240562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:58.241548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:58.242001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:58.242701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:58.243144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:58.243557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:58.273581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a6f0e002-6ced-4ad4-ac43-063243acea51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Oct 15 08:56:58.274231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 484/970] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:56:59.286304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:56:59.288563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:56:59.294895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:59.295365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:59.295792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:59.296461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:56:59.296941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:56:59.297353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:56:59.326236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-93df6569-f5ca-4abf-8dae-efc5fcfe2fb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Oct 15 08:56:59.326765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:56:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:00.339177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:00.341326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:00.347972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:00.348456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:00.348890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:00.349580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:00.350712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:00.351142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:00.379809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-395e96d0-7984-47f9-97fa-cdefb6f1dd1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Oct 15 08:57:00.380365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 485/972] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:01.392327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:01.394458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:01.400980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:01.401462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:01.402001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:01.402690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:01.403143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:01.403567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:01.433555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0eef4f32-a583-41bc-9c68-f9df04364138 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045290 Oct 15 08:57:01.434132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 488/973] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:02.446530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:02.448757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:02.455396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:02.455877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:02.456303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:02.456994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:02.457436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:02.457890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:02.487953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cf0c98d9-c1f5-4922-a8de-feff42157b8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046208 Oct 15 08:57:02.488515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 486/974] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:57:03.500389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:03.502690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:03.508921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:03.509404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:03.509883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:03.510604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:03.511079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:03.511503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:03.541553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8fd5e0d7-9168-474e-afe0-4120370a8468 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045091 Oct 15 08:57:03.542134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 489/975] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:04.554864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:04.557034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:04.563466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:04.563950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:04.564383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:04.565071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:04.565530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:04.565984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:04.594500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-508b1474-daa1-462b-8370-07d59f2c5a85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Oct 15 08:57:04.595044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 487/976] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:05.607031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:05.609227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:05.616205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:05.616686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:05.617122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:05.617845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:05.618301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:05.618724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:05.647983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8c7775d5-58e8-42db-ae78-ceab260fb704 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044959 Oct 15 08:57:05.648525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 490/977] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:06.660942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:06.663660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:06.670039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:06.670520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:06.670955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:06.671641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:06.672096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:06.672518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:06.703505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cf5fd722-0051-40e8-893b-ffa113019d5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Oct 15 08:57:06.704058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 488/978] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:07.716209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:07.718326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:07.724358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:07.725347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:07.725797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:07.726473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:07.726917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:07.727332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:07.756101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bda3708f-1873-473f-bcb7-f998dabecfed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Oct 15 08:57:07.756654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 491/979] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:08.768565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:08.770777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:08.773154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:08.778387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:08.778864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:08.779291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:08.779963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:08.780412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:08.780835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:08.784511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:08.810571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-be5ccb2b-0c1c-4cdb-9dfa-6acce1c5f5ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 Oct 15 08:57:08.811107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 489/980] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:09.823250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:09.825399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:09.827704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:09.832902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:09.833388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:09.833864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:09.834561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:09.835013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:09.835437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:09.839220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:09.865914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7d52c139-e740-4108-b9ec-3659e87c31e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Oct 15 08:57:09.866460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 492/981] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:10.878324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:10.880481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:10.887621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:10.888092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:10.888518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:10.889194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:10.889642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:10.890083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:10.918347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f0696b40-8b4d-45d7-a961-23f717ca05e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Oct 15 08:57:10.918880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 490/982] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:11.931279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:11.933503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:11.940001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:11.940486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:11.940923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:11.941608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:11.942094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:11.942519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:11.972202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-82fff099-76c7-43c0-be42-47bc444186f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Oct 15 08:57:11.972739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 493/983] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:12.984240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:12.986478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:12.993590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:12.994102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:12.994536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:12.995230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:12.995685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:12.996111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:13.025107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a8de4ee2-0c92-43c4-9fe5-2fcc89743424 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Oct 15 08:57:13.025653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 491/984] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:14.037744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:14.040079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:14.046727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:14.047213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:14.047651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:14.048336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:14.048790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:14.049239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:14.079646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-572766da-801e-4af8-95ef-dfb5de816c57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046164 Oct 15 08:57:14.080202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:15.091981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:15.094125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:15.101004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:15.101478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:15.101938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:15.102617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:15.103063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:15.103481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:15.132882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9ab06687-e74e-4f30-9f62-180004c5b316 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Oct 15 08:57:15.133433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 492/986] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:16.145450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:16.148237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:16.154710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:16.155194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:16.155629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:16.156316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:16.156768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:16.157189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:16.186928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5bfa600b-5e23-472c-84da-7419097c300e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Oct 15 08:57:16.187469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 495/987] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:17.199547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:17.201738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:17.208171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:17.208654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:17.209087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:17.209793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:17.210281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:17.210702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:17.240835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-26fb2e53-f84d-4c9c-8060-0498273988fa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Oct 15 08:57:17.241380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 493/988] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:18.253346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:18.256019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:18.262434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:18.262912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:18.263343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:18.264025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:18.264479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:18.264904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:18.295591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f04e15f4-29bc-473c-a078-00965b7e61f9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046162 Oct 15 08:57:18.296143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 496/989] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:19.308654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:19.310817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:19.317345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:19.317989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:19.318421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:19.319131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:19.319580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:19.320001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:19.350339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-248e3475-1909-4853-9323-c4a0796cf3e8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Oct 15 08:57:19.350895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 494/990] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:20.362102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:20.364271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:20.371445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:20.371921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:20.372351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:20.373034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:20.373484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:20.373931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:20.403210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1a597a22-d51f-4fdc-879b-f29c10c5dbdc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045025 Oct 15 08:57:20.403764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:21.416812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:21.418978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:21.425495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:21.426012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:21.426447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:21.427133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:21.427586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:21.428010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:21.456432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0451d45f-c119-47d0-8a09-ce76579367b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Oct 15 08:57:21.456983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 495/992] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:22.468415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:22.470569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:22.477373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:22.477883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:22.478314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:22.478989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:22.479437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:22.479854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:22.508730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-21e3f062-9673-4e58-ad1a-74b0f79047de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Oct 15 08:57:22.509266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 498/993] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:23.521389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:23.523567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:23.530079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:23.530563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:23.530997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:23.531687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:23.532139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:23.532561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:23.562381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7a64d0ef-8219-438a-ada6-d2fe7f7f0b7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045548 Oct 15 08:57:23.562929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 496/994] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:24.574398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:24.576569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:24.582953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:24.583937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:24.584372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:24.585060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:24.585512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:24.585965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:24.616041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-df8ff943-4cb7-4c61-9263-599fbc3e7583 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045606 Oct 15 08:57:24.616584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 499/995] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:25.628510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:25.630682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:25.637071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:25.637554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:25.638024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:25.638712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:25.639168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:25.639593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:25.668734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f66cf1da-d875-487f-b6fb-77dd1b1c9864 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Oct 15 08:57:25.669219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 497/996] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:26.681805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:26.684798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:26.691320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:26.691910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:26.692346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:26.693033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:26.693480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:26.694639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:26.723849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-33ed6c0a-1ed6-4af5-b7a7-0510689fd12a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046694 Oct 15 08:57:26.724513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 500/997] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:27.736990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:27.739139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:27.746249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:27.746733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:27.747166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:27.747854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:27.748307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:27.748728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:27.777144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cb87f946-b5fd-4222-9aba-82ed5c445d25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Oct 15 08:57:27.777698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 498/998] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:28.790016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:28.792184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:28.798635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:28.799115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:28.799550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:28.800231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:28.800681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:28.801103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:28.830481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4dbad8ab-b75a-4319-a168-4dcf74054c21 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Oct 15 08:57:28.831017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 501/999] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:29.842864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:29.845069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:29.852096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:29.852574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:29.853006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:29.853713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:29.854176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:29.854594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:29.883431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2d88c1f6-a25a-4ed2-abb0-cdd3eba86af1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Oct 15 08:57:29.883969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 499/1000] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:30.895805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:30.898059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:30.904412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:30.904895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:30.905332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:30.906047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:30.906500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:30.906926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:30.940918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5e7ed4fc-90b0-4a20-8efd-f77cc788b6a7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049094 Oct 15 08:57:30.941467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 502/1001] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:57:31.953228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:31.955438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:31.962010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:31.962493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:31.962925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:31.963609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:31.964064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:31.964488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:31.993932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-adca682f-b649-4170-b3ed-1f3efb718e65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Oct 15 08:57:31.994488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 500/1002] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:33.007329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:33.009482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:33.015990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:33.016478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:33.016916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:33.017606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:33.018091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:33.018518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:33.048070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-75c35f56-c133-4900-a6cd-17034dc0b54e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045345 Oct 15 08:57:33.048609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 503/1003] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:34.059898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:34.062109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:34.069137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:34.069616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:34.070082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:34.070768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:34.071222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:34.071647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:34.101700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0ba282f4-cd6c-483d-b1f1-8d495ac18eb2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Oct 15 08:57:34.102265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 501/1004] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:35.114123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:35.116771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:35.123112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:35.123592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:35.124022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:35.124699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:35.125148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:35.125573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:35.155377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a565875d-4fac-4a2c-99ad-37fe74ca2402 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Oct 15 08:57:35.155918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 504/1005] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:36.167644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:36.169879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:36.176237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:36.176746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:36.177176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:36.177897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:36.178345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:36.178774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:36.208371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0458ca27-456c-4248-a1f6-a880981b2813 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Oct 15 08:57:36.209584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 502/1006] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:37.220465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:37.222675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:37.229290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:37.229803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:37.230231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:37.230907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:37.231352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:37.231766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:37.259957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-19a4d196-2b02-4b09-ab4b-11e4cc836733 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043438 Oct 15 08:57:37.260489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 505/1007] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:38.272678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:38.275130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:38.281484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:38.281998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:38.282434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:38.283116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:38.283562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:38.283979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:38.314073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7733c9db-29ff-4be4-ba91-2c54d8e0bf47 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045494 Oct 15 08:57:38.314617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 503/1008] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:39.326140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:39.328281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:39.335211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:39.335687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:39.336117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:39.336797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:39.337246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:39.337669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:39.367562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8f780d3-d3b6-4ac8-bece-c5bf49b35d45 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Oct 15 08:57:39.368112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 506/1009] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:40.379917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:40.382739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:40.385045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:40.390665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:40.391150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:40.391585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:40.392281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:40.392735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:40.393158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:40.395626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:40.423819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-27d0e55a-a18f-4a2e-896d-0d63d91503bb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047850 Oct 15 08:57:40.424376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 504/1010] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:41.436457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:41.438628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:41.440893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:41.446795 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:41.447274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:41.447706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:41.448391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:41.448841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:41.449261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:41.452812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:57:41.478619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-00ecfd52-d5f0-4a49-9a18-ecb35a6dd991 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046120 Oct 15 08:57:41.479158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 507/1011] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:42.490185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:42.492336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:42.498872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:42.499355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:42.499790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:42.500478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:42.500932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:42.501355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:42.530822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8a5c4b6d-423b-4401-8688-7cf63153eebf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Oct 15 08:57:42.531393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 505/1012] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:57:43.543874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:43.546013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:43.553155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:43.553627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:43.554077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:43.554753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:43.555201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:43.555616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:43.583915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-130d6826-c7c1-482b-8211-2e58c1273063 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044002 Oct 15 08:57:43.584452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 508/1013] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:44.596279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:44.598449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:44.605514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:44.606048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:44.606487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:44.607181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:44.607638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:44.608066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:44.637018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-da035cfb-3985-48c6-a04a-bf55b56f4f49 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Oct 15 08:57:44.637564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 506/1014] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:45.649441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:45.651599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:45.658317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:45.658808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:45.659247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:45.660243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:45.660700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:45.661127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:45.691307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-87f12914-5a20-43ae-892d-bd6e919b7d5b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Oct 15 08:57:45.691854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 509/1015] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:46.703176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:46.705231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:46.711566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:46.712045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:46.712479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:46.713156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:46.713607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:46.714055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:46.743336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1abfe9b3-a67f-4a69-9f46-46b5e92c8a70 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Oct 15 08:57:46.743878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 507/1016] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:47.755033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:47.757818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:47.764407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:47.764885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:47.765319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:47.766036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:47.766507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:47.766915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:47.795822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ca82753c-323e-48e6-8571-c8e5bc761627 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Oct 15 08:57:47.796371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 510/1017] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:48.809171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:48.811368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:48.817901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:48.818403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:48.818825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:48.819514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:48.819972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:48.820407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:48.849741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-77eb0da2-3f81-4436-a941-8281935557c2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Oct 15 08:57:48.850292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 508/1018] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:49.862564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:49.865259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:49.871917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:49.872413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:49.872840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:49.873535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:49.874010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:49.874433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:49.906068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-774bee26-b755-43c6-8b1a-c470fc2627a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047397 Oct 15 08:57:49.906643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 511/1019] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:50.919084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:50.921166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:50.928244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:50.928723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:50.929154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:50.929871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:50.930327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:50.930751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:50.959082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4f214c9f-1e32-42a8-ab64-4f2cef38774d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 Oct 15 08:57:50.959621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 509/1020] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:51.971328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:51.973400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:51.979786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:51.980262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:51.980690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:51.981358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:51.981836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:51.982253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:52.011538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c6312849-2731-4a6d-bd7f-573ee04b140f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Oct 15 08:57:52.012064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 512/1021] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:53.024505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:53.026653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:53.033122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:53.033599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:53.034056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:53.034740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:53.035457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:53.035876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:53.065542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f7ddd94c-016f-4729-a3e1-18ae7eec73e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Oct 15 08:57:53.066122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 510/1022] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:54.077941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:54.080077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:54.087100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:54.087578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:54.088010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:54.088690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:54.089142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:54.089564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:54.117688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a68dbfb9-90a4-4ad9-9d14-d05ccface485 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Oct 15 08:57:54.118237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 513/1023] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:55.130093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:55.132899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:55.139259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:55.139737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:55.140166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:55.140845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:55.141292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:55.141737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:55.173067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-758b4ebb-9d60-48f5-85ff-2562c3e975ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Oct 15 08:57:55.173619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 511/1024] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:56.184844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:56.187023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:56.194333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:56.195092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:56.195437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:56.196140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:56.196586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:56.197003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:56.226316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fbf8f62c-2f8e-4858-936e-8d54044b8090 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Oct 15 08:57:56.226858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 514/1025] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:57.238116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:57.240244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:57.246813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:57.247283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:57.247710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:57.248384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:57.248830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:57.249245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:57.279403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-555abde7-99fe-466e-90b4-77b94d4f03eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Oct 15 08:57:57.279966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 512/1026] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:58.292465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:58.294693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:58.300958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:58.301436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:58.301918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:58.302603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:58.303055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:58.304042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:58.332999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2f0c681-d760-45a5-91e9-c11fe8516401 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Oct 15 08:57:58.333535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 515/1027] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:57:59.344405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:57:59.346596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:57:59.353513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:59.354026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:59.354480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:59.355170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:57:59.355624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:57:59.356045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:57:59.385250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c627f1fe-6203-495e-97e5-20cd194874fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 Oct 15 08:57:59.385830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 513/1028] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:57:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:00.398096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:00.400153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:00.406811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:00.407290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:00.407723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:00.408410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:00.408864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:00.409284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:00.438831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4fb82396-41a0-49df-a0e6-2f160e029d60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045317 Oct 15 08:58:00.439375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 516/1029] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:01.451169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:01.453218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:01.460390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:01.460870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:01.461303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:01.462011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:01.462462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:01.462879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:01.491489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3fb51f18-0889-4b3b-842e-5e80b24985e1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044341 Oct 15 08:58:01.492020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 514/1030] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:02.503904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:02.506078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:02.512966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:02.513438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:02.513899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:02.514578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:02.515028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:02.515446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:02.545133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-85d042e5-1b8b-4a5d-81ee-627686970d9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Oct 15 08:58:02.545701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 517/1031] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:03.557949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:03.560060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:03.566467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:03.566937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:03.567365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:03.568039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:03.568486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:03.569531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:03.598151 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1ad177d9-950b-4b6b-b859-744549ecce32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Oct 15 08:58:03.598690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 515/1032] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:04.611027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:04.613210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:04.619763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:04.620328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:04.620759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:04.621435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:04.621918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:04.622339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:04.651982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ebbb8bac-32e1-41e1-a443-f20b617ab244 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Oct 15 08:58:04.652462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 518/1033] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:05.664236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:05.666307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:05.672633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:05.673108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:05.673537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:05.674249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:05.674699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:05.675119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:05.703487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7880d487-91cc-4767-882c-7a2488461011 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Oct 15 08:58:05.704029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 516/1034] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:06.716238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:06.718314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:06.724140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:06.724618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:06.725047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:06.725748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:06.726199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:06.726619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:06.755047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-42a3edbb-372f-473d-8a25-10cc9d795b81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Oct 15 08:58:06.755580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 519/1035] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:07.767935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:07.770205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:07.776686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:07.777111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:07.777546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:07.778266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:07.778724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:07.779146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:07.809325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-91e9e52e-6634-4bc1-90ed-6411883dfc0d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045510 Oct 15 08:58:07.809904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 517/1036] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:08.822284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:08.824462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:08.831150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:08.831634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:08.832069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:08.832759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:08.833239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:08.833690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:08.862614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e0339bd7-1519-4a74-899e-1b1f9fa0de9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Oct 15 08:58:08.863149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 520/1037] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:09.875621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:09.877808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:09.884726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:09.885224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:09.885649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:09.886365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:09.886823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:09.887251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:09.916754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-15cd73ac-2d5c-4214-98b5-b855bc92d0d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Oct 15 08:58:09.917302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 518/1038] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:10.929197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:10.931344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:10.937623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:10.938127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:10.938555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:10.939230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:10.939674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:10.940091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:10.968943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3e9bcbcf-cdda-4399-b50b-81c0bbcc57f8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Oct 15 08:58:10.969471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 521/1039] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:11.980989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:11.983142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:11.985970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:11.991349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:11.991926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:11.992357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:11.993038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:11.993485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:11.994003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:11.997769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:12.024059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-950d5479-b778-479f-b6fd-7197f8ffb337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Oct 15 08:58:12.024601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 519/1040] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:13.036277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:13.039098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:13.041366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:13.046530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:13.047004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:13.047433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:13.048118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:13.048562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:13.048979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:13.052652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:13.077585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bc7ff2de-0576-41c3-99f9-a39c65359ad6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Oct 15 08:58:13.078163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 522/1041] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:14.089943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:14.092149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:14.098775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:14.099261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:14.100199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:14.100886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:14.101350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:14.101807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:14.130985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6a2261f3-9237-4345-9381-0c0b9ee14fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Oct 15 08:58:14.131527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 520/1042] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:15.143431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:15.145611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:15.152170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:15.152648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:15.153080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:15.153803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:15.154255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:15.154680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:15.185197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bf62a150-cff5-4cac-ad0a-eb34f7bd0f92 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Oct 15 08:58:15.185769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 523/1043] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:16.198729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:16.200870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:16.207537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:16.208020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:16.208453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:16.209139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:16.209671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:16.210123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:16.238827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-df0eddc7-073c-4055-a0e8-85d0cccaa75c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045470 Oct 15 08:58:16.239379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 521/1044] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:17.251337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:17.253507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:17.259942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:17.260419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:17.260852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:17.261531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:17.262015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:17.262442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:17.291665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9fb11a78-8140-4380-b24f-45762d4cb46a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Oct 15 08:58:17.292200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 524/1045] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:18.304110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:18.306288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:18.312697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:18.313177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:18.313619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:18.314342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:18.314799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:18.315226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:18.344916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f22efea8-1ab0-48c2-b098-3e32776ef87a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Oct 15 08:58:18.345469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 522/1046] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:19.357957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:19.360120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:19.366563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:19.367037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:19.367466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:19.368144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:19.368588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:19.369001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:19.399124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-204b0844-da72-4040-b1ff-86802fa4828a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 15 08:58:19.399745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 525/1047] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:20.412336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:20.414551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:20.420943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:20.421434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:20.421917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:20.422612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:20.423072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:20.423501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:20.452603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dec18538-91f1-4aa4-b975-0bf25be07c9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Oct 15 08:58:20.453160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 523/1048] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:21.465328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:21.467498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:21.473931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:21.474994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:21.475422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:21.476097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:21.476545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:21.476961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:21.505521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-87f01338-e23b-4757-bea8-db3576838276 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Oct 15 08:58:21.506099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 526/1049] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:22.517400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:22.519577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:22.525939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:22.526418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:22.526851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:22.527536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:22.527989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:22.528408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:22.558399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-78f75bea-395a-4f69-b0bc-d4372c353258 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Oct 15 08:58:22.558944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 524/1050] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:23.570980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:23.573860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:23.580280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:23.580762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:23.581195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:23.581918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:23.582371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:23.582795 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:23.611511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b825ab36-49b3-4191-b195-c0fd6362b018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Oct 15 08:58:23.612051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 527/1051] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:24.624431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:24.626633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:24.633639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:24.634161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:24.634599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:24.635280 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:24.635734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:24.636155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:24.665579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f0562185-d91f-45f6-ab36-033c8187ad39 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Oct 15 08:58:24.666091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 525/1052] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:25.678474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:25.680595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:25.687034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:25.687510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:25.687941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:25.688615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:25.689090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:25.689508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:25.718136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d990510c-a0de-49cb-ae9d-104aa0c1cdc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Oct 15 08:58:25.718663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 528/1053] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:26.729984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:26.732168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:26.738530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:26.739017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:26.739455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:26.740142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:26.741112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:26.741536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:26.770591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ef74d9c9-dbba-47f9-b5fc-393e920ada64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Oct 15 08:58:26.771136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 526/1054] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:27.782859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:27.785254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:27.791875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:27.792352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:27.792783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:27.793463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:27.793938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:27.794356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:27.823621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f6c2d7d6-e549-45b8-bd2a-64998a984133 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 Oct 15 08:58:27.824168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 529/1055] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:28.835971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:28.838080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:28.844410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:28.844887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:28.845316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:28.846020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:28.846562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:28.846985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:28.875842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-54330d17-9630-417f-bf02-a0c5429c0355 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Oct 15 08:58:28.876374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 527/1056] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:29.888170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:29.890332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:29.896655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:29.897134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:29.897565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:29.898275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:29.898729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:29.899152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:29.928961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-405a6acd-4da9-4ed7-a5bf-b1426c08c522 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 Oct 15 08:58:29.929502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 530/1057] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:30.941385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:30.944071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:30.950691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:30.951167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:30.951596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:30.952276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:30.952725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:30.953149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:30.982657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4d09a70a-450e-4445-8686-ea4d42579afe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Oct 15 08:58:30.983204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 528/1058] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:31.995432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:31.997602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:32.003958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:32.004440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:32.004880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:32.005566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:32.006706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:32.007132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:32.036275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4f4b9ec-6a93-4e5b-ad96-6115b6a1bb85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044849 Oct 15 08:58:32.036812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 531/1059] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:33.048809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:33.050958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:33.057938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:33.058419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:33.058853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:33.059537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:33.059987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:33.060440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:33.088666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1f3c0fa6-769d-4492-b9ec-e5cef68fc904 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Oct 15 08:58:33.089207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 529/1060] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:34.101292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:34.103467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:34.109873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:34.110352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:34.110782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:34.111492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:34.111943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:34.112363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:34.142930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4bb03f4b-5d71-41d8-9cef-a1d99128ae3d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Oct 15 08:58:34.143466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 532/1061] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:35.155424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:35.157632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:35.164438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:35.164921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:35.165354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:35.166069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:35.166529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:35.166951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:35.197461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3dd5ed34-8744-4444-81ad-6eaa9a6af132 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Oct 15 08:58:35.198252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 530/1062] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:36.210038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:36.212087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:36.218547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:36.219025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:36.219453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:36.220128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:36.220576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:36.220996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:36.249913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a444b4d4-86e4-42ce-91c8-718aa3533feb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Oct 15 08:58:36.250444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 533/1063] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:37.261793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:37.263926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:37.270062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:37.270636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:37.271067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:37.271779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:37.272229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:37.272647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:37.301878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d51dd745-3ac2-4441-9dc5-c2c774b61aa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Oct 15 08:58:37.302419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 531/1064] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:38.313978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:38.316135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:38.322475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:38.322974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:38.323387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:38.324068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:38.324576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:38.324921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:38.356053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-79650ede-eb1a-4179-8d13-872ea9ddc085 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Oct 15 08:58:38.356921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 534/1065] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:39.367813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:39.369953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:39.376270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:39.376743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:39.377176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:39.377888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:39.378431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:39.378852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:39.410993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8f913e58-3f0b-46ca-bc20-51d26b4efdb9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Oct 15 08:58:39.411865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 532/1066] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:40.425301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:40.428217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:40.434502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:40.434975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:40.435402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:40.436075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:40.436520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:40.436936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:40.470818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3f7bc3b4-9ce5-4c5a-a65e-8415b9341c08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049419 Oct 15 08:58:40.471388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 535/1067] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:41.483818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:41.485925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:41.492879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:41.493351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:41.493809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:41.494488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:41.494935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:41.495358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:41.527571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-da368950-799f-4e11-823c-31290f3a9667 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047732 Oct 15 08:58:41.528131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 533/1068] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:42.540830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:42.542958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:42.549336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:42.549861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:42.550296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:42.550978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:42.551434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:42.551858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:42.582234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cb6aa3ee-a893-48b6-a1bf-417c637bbfd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045855 Oct 15 08:58:42.582779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 536/1069] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:58:43.594950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:43.597053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:43.599360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=30 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:43.605066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:43.605544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:43.606008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:43.606694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:43.607146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:43.607568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:43.610083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=90 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:43.639033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-08bbb38b-19b8-4b17-94b1-557e2f64145b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 Oct 15 08:58:43.639587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 534/1070] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:44.651654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:44.653922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:44.656725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:44.662860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:44.663404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:44.663841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:44.664541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:44.665000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:44.665420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:44.668155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=90 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:44.696742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-36a8d33b-81b8-4d71-9f47-fb79dce44e81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049242 Oct 15 08:58:44.697276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 537/1071] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:45.709505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:45.712346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:45.718761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:45.719237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:45.719664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:45.720341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:45.720791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:45.721211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:45.750952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bf6ca331-2849-4a9c-a4b2-dbc3066366a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Oct 15 08:58:45.751520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 535/1072] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:46.763505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:46.765719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:46.772441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:46.772965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:46.773436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:46.774199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:46.774712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:46.775149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:46.805274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d8d18ea6-de9c-40e3-b045-be9532d52b9d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045912 Oct 15 08:58:46.805841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 538/1073] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:47.817834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:47.820564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:47.827227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:47.827716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:47.828156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:47.828857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:47.829320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:47.829771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:47.859275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-04acc2bb-d110-4ef8-b74e-2acc22e2a7eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Oct 15 08:58:47.859828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 536/1074] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:48.873257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:48.875425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:48.881753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:48.882238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:48.882676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:48.883371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:48.883826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:48.884253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:48.915165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a27ea99b-12c8-4a38-b744-3824a9a28c89 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045810 Oct 15 08:58:48.915709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 539/1075] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:49.927647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:49.929963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:49.936393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:49.936879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:49.937320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:49.938061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:49.938554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:49.938968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:49.968558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e7184e81-d0c2-417a-bec6-7c179a7d932f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Oct 15 08:58:49.969426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 537/1076] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:50.980900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:50.982992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:50.989292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:50.989809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:50.990240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:50.991510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:50.991972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:50.992396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:51.020488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2632217-813c-46ad-be50-7fc7508db877 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043562 Oct 15 08:58:51.021021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 540/1077] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:52.032189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:52.034370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:52.041626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:52.042140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:52.042574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:52.043260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:52.043718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:52.044142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:52.072807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b920f855-18ec-4407-8f1b-f1c0be1f1ec5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 Oct 15 08:58:52.073353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 538/1078] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:53.084405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:53.086546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:53.092850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:53.093324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:53.093775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:53.094458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:53.094900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:53.095320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:53.125219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a8aae2a6-ebef-45d3-9cd0-c99c037796c3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044686 Oct 15 08:58:53.125765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 541/1079] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:53.844534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:53.845040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:53.851426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:53.851912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:53.852423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:53.853041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:53.853555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:53.854044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:53.880519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:58:53.988560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-89d1a95c-aadd-4e06-8e3c-1381accee3b3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "DELETE /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 204 len: 0 microversion: 2.1 time: 0.147498 Oct 15 08:58:53.993183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 539/1080] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:58:53 2022] DELETE /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:58:53.998099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:53.998706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:54.004632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:54.005108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:54.005534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:54.006266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:54.007246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:54.007660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:54.138782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:54.141121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:54.147951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:54.148448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:54.148882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:54.149586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:54.150083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:54.150510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:54.183094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b3cef9b5-cb67-41f0-b555-a9ff3dcfabfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048616 Oct 15 08:58:54.183655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 540/1081] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:58:54.310034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:54.318173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-66550d55-944e-4e0d-b18c-1b37e2fbd88a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.324094 Oct 15 08:58:54.318746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 542/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:55.008686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:55.009738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:55.016096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.016582 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.017015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.017724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.018192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.018614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.046187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:58:55.118505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9287ed0a-1a29-4269-83d3-38bfaab184c9 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 204 len: 0 microversion: 2.1 time: 0.113321 Oct 15 08:58:55.119060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 541/1083] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:58:55 2022] DELETE /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:58:55.127420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:55.128031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:55.134592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.135076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.135509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.136200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.136656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.137080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.197940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:55.200587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:55.208215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.208705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.209143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.210384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.210842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.211264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.245537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-79fd7ed1-78be-429a-9c8f-b7604d9e06ac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053361 Oct 15 08:58:55.246139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 542/1084] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:58:55.273030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:55.280736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-636eca57-2254-4dbb-820c-132f95741d75 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1556 microversion: 2.1 time: 0.157128 Oct 15 08:58:55.281288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 543/1085] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:55 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:55.341661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:55.342293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:55.348172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.348656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.349088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.349803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:55.350262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:55.350688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:55.531565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:55.540077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-507cbe2b-d906-4aeb-b717-8365d9681cf1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.202272 Oct 15 08:58:55.540639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 543/1086] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:55 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:56.167954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d610f4-f0b3-42b0-a0da-49f639edb8a4", "name": "network-vif-deleted", "tag": "8a417772-ea4c-4158-816d-dad8275496c9"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:58:56.178840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.179588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.180090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.191204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] Creating event network-vif-deleted:8a417772-ea4c-4158-816d-dad8275496c9 for instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 on hv-cinder-85697 Oct 15 08:58:56.196990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-953704c1-c38d-4c17-9ba3-24f0f141c42e req-dbf0b1a5-f10d-4ad8-8ebe-fbf1907d61dc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090228 Oct 15 08:58:56.197661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 544/1087] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:58:56.258116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:56.260420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:56.267042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.267530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.267965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.268682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.269133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.269558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.303087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5db5ec41-e6e0-4743-b7a4-38f066dcab65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049053 Oct 15 08:58:56.304013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:56.305332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:56.308644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 544/1088] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:56.311509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.311992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.312424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.313109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.313563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.314015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.344627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.345119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.345551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.346056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lazy-loading 'fault' on Instance uuid d4d610f4-f0b3-42b0-a0da-49f639edb8a4 {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 08:58:56.391804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05cbab4640048589b9509fd9e8f655a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '678aa241e39f4bea9fa9e73e82afbd0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:56.401434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-73fb9edd-f268-4d70-90f6-c0a727a2c6e4 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 200 len: 1349 microversion: 2.1 time: 0.102052 Oct 15 08:58:56.402195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 545/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:56 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 1349 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:56.563267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:56.563881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:56.569892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.570375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.570806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.571486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:56.572023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:56.572445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:56.698441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:56.706679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8a488745-5c32-419e-8399-b9f09f738291 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147411 Oct 15 08:58:56.707248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 545/1090] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:57.316282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:57.318587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:57.325648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.326157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.326591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.327272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.327720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.328154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.357877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2ecc9808-fa91-4593-9431-a34abb096c8e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Oct 15 08:58:57.358427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 546/1091] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:57.426538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:57.427155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] [instance: d4d610f4-f0b3-42b0-a0da-49f639edb8a4] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:57.434209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.434687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.435125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.435811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.436261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.436681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.450530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] HTTP exception thrown: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Request method failure captured: Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 HTTP/1.1 Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnNO6e-JE_P7nxQW1Vh2l5zpArZjIAHymW7qtY7aOMbK4W9xsmqQjwITf3iVSbOV4Xux0atLLv65V35QmCz-aostKpQG7qQLFWFpyOSWBznrYXVfB8Edu9hWm8fBg750PPLfh3F410L0yT1GPv0EbayCU5hv25CnunfsJT2mZz1vexk Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: 678aa241e39f4bea9fa9e73e82afbd0b Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-TestMinimumBasicScenario-581698048 Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 08:58:57.452164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/678aa241e39f4bea9fa9e73e82afbd0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/678aa241e39f4bea9fa9e73e82afbd0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/678aa241e39f4bea9fa9e73e82afbd0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_678aa241e39f4bea9fa9e73e82afbd0b", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-TestMinimumBasicScenario-581698048 Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: 678aa241e39f4bea9fa9e73e82afbd0b Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-TestMinimumBasicScenario-581698048 Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-TestMinimumBasicScenario-581698048-project Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: f05cbab4640048589b9509fd9e8f655a Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-TestMinimumBasicScenario-581698048-project Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. Oct 15 08:58:57.453837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': 'd4d610f4-f0b3-42b0-a0da-49f639edb8a4'} Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:58:57.454790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. Oct 15 08:58:57.456324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 08:58:57.457864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Returning 404 to user: Instance d4d610f4-f0b3-42b0-a0da-49f639edb8a4 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:58:57.457864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d118da82-931a-4352-9eeb-1d3875fe5d12 tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4" status: 404 len: 111 microversion: 2.1 time: 0.030949 Oct 15 08:58:57.457864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 546/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:57 2022] GET /compute/v2.1/servers/d4d610f4-f0b3-42b0-a0da-49f639edb8a4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:58:57.462576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4395bc1-b9c0-4f2a-9e4d-cbd242ab949c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] Calling method '.version_select at 0x7f575e585280>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:57.484300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4395bc1-b9c0-4f2a-9e4d-cbd242ab949c tempest-TestMinimumBasicScenario-581698048 tempest-TestMinimumBasicScenario-581698048-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501984454" status: 202 len: 0 microversion: 2.1 time: 0.026014 Oct 15 08:58:57.484845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 547/1093] 10.222.0.30 () {58 vars in 1272 bytes} [Sat Oct 15 08:58:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501984454 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:58:57.730665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:57.731300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:57.737257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.737900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.738338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.739024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:57.739469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:57.739885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:57.876502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:57.885642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8a441c77-1119-405d-8344-e67add092f94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.158710 Oct 15 08:58:57.886232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 547/1094] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:58.370323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:58.372423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:58.379084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:58.379560 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:58.380079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:58.380675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:58.381118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:58.382113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:58.412275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4d2cb2d9-235b-4599-9294-78b331caba82 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046401 Oct 15 08:58:58.412871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 548/1095] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:58:58.908528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:58.909145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:58.916370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:58.916968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:58.917956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:58.919091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:58.919253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:58.919649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:58.924055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:58:59.107891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:58:59.117914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f566578d-3c70-430b-9f96-3514d924b7fd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.213225 Oct 15 08:58:59.118490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 548/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:58:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:58:59.424644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:58:59.427039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:58:59.434149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:59.434643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:59.435111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:59.436018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:58:59.436541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:58:59.436974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:58:59.467453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6b71e7e5-0c3b-4565-92f6-6aa88383a3fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046843 Oct 15 08:58:59.468017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 549/1097] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:58:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:00.141992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:00.142419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:00.149335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:00.150042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:00.150483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:00.151185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:00.151638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:00.152055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:00.413354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:00.422213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46f3100f-96f0-4321-8b71-93ddab9dff06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.284328 Oct 15 08:59:00.426086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 549/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:00 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:00.483028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:00.485381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:00.492838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:00.493335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:00.493821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:00.494553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:00.495003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:00.495424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:00.527780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6b6cd0d3-8f83-45ec-b790-7c8e2ebf5664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Oct 15 08:59:00.528366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 550/1099] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:01.446824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:01.447631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:01.454343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:01.454965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:01.455506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:01.456303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:01.456961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:01.457490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:01.543019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:01.546503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:01.556361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:01.557037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:01.557561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:01.558366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:01.559073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:01.559750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:01.600393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9a37e87a-21ea-4743-bd03-85cf193f0a57 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063471 Oct 15 08:59:01.601476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 551/1100] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:01.628028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:01.645138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-96ffaae9-e5ac-401f-84cf-5b57069f1b74 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.202783 Oct 15 08:59:01.645897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 550/1101] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:01 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:02.612645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:02.615202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:02.623447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:02.623968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:02.624982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:02.625274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:02.625753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:02.626794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:02.669234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3dd6281e-8fba-4a59-931c-1c6b2160e26c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060502 Oct 15 08:59:02.669834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 552/1102] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:02.670184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:02.670869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:02.677456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:02.678740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:02.679366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:02.680168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:02.680623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:02.681212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:02.879693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:02.888204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dcb08ebc-28f2-4aaf-a458-6623e5480472 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.221962 Oct 15 08:59:02.889020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 551/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:02 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:03.681869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:03.684004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:03.690353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:03.690849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:03.691281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:03.691965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:03.692408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:03.692844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:03.724305 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-465325b4-10aa-494c-9c31-519526fe9b46 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047131 Oct 15 08:59:03.725178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 553/1104] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:03.911018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:03.911775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:03.918484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:03.918962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:03.919388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:03.920113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:03.920563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:03.920983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:04.084590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:04.094682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dba41629-c9fc-4df8-a3b3-5311f4cf2c1f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.187814 Oct 15 08:59:04.095776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 552/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:04.736626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:04.739050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:04.746201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:04.746682 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:04.747113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:04.747805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:04.748250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:04.748670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:04.778600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3e0a3d58-fa18-4c78-95d4-5c35873c3bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045962 Oct 15 08:59:04.781403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 554/1106] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:05.119288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:05.120099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:05.126671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:05.127161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:05.127626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:05.128317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:05.128774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:05.129201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:05.290087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:05.300784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cea7f3fb-a53a-440b-aba1-ae4b82cd2b2b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.186183 Oct 15 08:59:05.301358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 553/1107] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:05.791416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:05.793606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:05.800085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:05.800568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:05.801004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:05.801699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:05.802168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:05.802590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:05.806271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:05.832335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2d374b61-189f-4703-a8b5-48bcd00239ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Oct 15 08:59:05.832898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 555/1108] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:06.327874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:06.328487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:06.334969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:06.335454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:06.335885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:06.336580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:06.337208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:06.337442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:06.464408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:06.472641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2f94eddc-fc55-4ae7-868e-db041c9b4116 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148603 Oct 15 08:59:06.473214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 554/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:06.845652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:06.847788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:06.853763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:06.854247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:06.854681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:06.855362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:06.855816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:06.856242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:06.885927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9d3099a8-e48b-42eb-b280-1626f29a62ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Oct 15 08:59:06.886465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 556/1110] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:07.496364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:07.496982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:07.503065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:07.503550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:07.503982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:07.504668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:07.505122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:07.505548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:07.630662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:07.638886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c829d988-eb00-4265-809d-3c63f90ee474 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146401 Oct 15 08:59:07.639444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 555/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:07 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:07.898752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:07.900834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:07.907222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:07.907696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:07.908132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:07.908808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:07.909259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:07.909962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:07.939179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-151f12bb-f1d5-4bbe-824d-fc3ebf54369f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Oct 15 08:59:07.939721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 557/1112] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:08.663086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:08.663574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:08.670156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:08.670633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:08.671061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:08.671739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:08.672183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:08.672599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:08.802153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:08.810906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8a5b6634-e1c5-4d37-95a7-ae9f4ec88671 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151989 Oct 15 08:59:08.811459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 556/1113] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:08 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:08.951480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:08.953534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:08.959814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:08.960285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:08.960711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:08.961385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:08.961862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:08.962277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:08.991777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-124d03aa-1daa-4517-9e70-23e65471ae15 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Oct 15 08:59:08.992311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 558/1114] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:09.833403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:09.834698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:09.841236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:09.841753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:09.842225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:09.842918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:09.843375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:09.843799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:09.966756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:09.975145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cc1ad836-4cf8-45cd-afa9-ea4455e18b16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145235 Oct 15 08:59:09.975710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 557/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:10.004015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:10.006829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:10.013170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:10.013643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:10.014099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:10.014775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:10.015218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:10.015632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:10.045381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6a63658b-4579-4f8b-9e19-989918446e17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Oct 15 08:59:10.045948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 559/1116] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:10.997573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:10.998238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:11.004774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:11.005253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:11.006211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:11.006914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:11.007369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:11.007798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:11.058272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:11.060422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:11.067524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:11.068018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:11.069008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:11.069725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:11.070186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:11.070611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:11.102035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c80a4d89-b876-4b14-9ee8-c82999f8657f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048010 Oct 15 08:59:11.102606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 560/1117] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:11.145208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:11.154075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-710aff53-38ea-47f9-ad25-965a234d0bcd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.160301 Oct 15 08:59:11.154757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 558/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:12.114764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:12.117464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:12.123796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:12.124282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:12.124712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:12.125391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:12.125872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:12.126295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:12.155316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7020bca9-e1a7-470b-a814-d8d6aee00a27 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Oct 15 08:59:12.155857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 561/1119] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:12.180567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:12.181208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:12.187759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:12.188239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:12.188670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:12.189356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:12.189834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:12.190255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:12.318535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:12.326788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d3b6575-c99f-40e3-b7ca-79f070426149 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150362 Oct 15 08:59:12.327386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 559/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:13.168060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:13.170153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:13.176475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:13.176959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:13.177393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:13.178605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:13.179055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:13.179479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:13.208555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-06446644-94b6-4bca-ad82-b17dff89a81b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Oct 15 08:59:13.209097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 562/1121] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:13.349911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:13.350529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:13.356830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:13.357352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:13.357808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:13.358489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:13.358934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:13.359346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:13.488017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:13.496730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e98a6ba2-cf8c-4fdd-b3dd-d1e0dc5bd146 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151189 Oct 15 08:59:13.497410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 560/1122] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:14.221397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:14.223590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:14.229983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:14.230497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:14.230926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:14.231608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:14.232054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:14.232476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:14.261574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-75f7808b-aad5-469f-8cf4-771a133fa28e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Oct 15 08:59:14.262149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 563/1123] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:14.519888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:14.520504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:14.522844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:14.528948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:14.529433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:14.529911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:14.530601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:14.531051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:14.531473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:14.659271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:14.667671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c7a32ecd-3578-4ec8-9df5-c247a4eed603 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151676 Oct 15 08:59:14.668227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 561/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:14 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:15.274166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:15.276246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:15.278528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:15.283686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:15.284165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:15.284866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:15.285548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:15.286021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:15.286444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:15.317478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-19f4c81e-8176-44c6-993e-985a9e6da359 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Oct 15 08:59:15.318097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 564/1125] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:15.691439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:15.692065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:15.699075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:15.699557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:15.699990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:15.700684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:15.701178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:15.701628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:15.827010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:15.836114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8648bb8d-cdae-481a-b8eb-87453aa287d9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148865 Oct 15 08:59:15.836676 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 562/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:16.330561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:16.332652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:16.339597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:16.340074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:16.340498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:16.341180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:16.341623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:16.342059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:16.371407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f4dd85f-5c8f-43e4-8b48-e9956952ac56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Oct 15 08:59:16.371956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 565/1127] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:16.859069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:16.859702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:16.866673 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:16.867153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:16.867581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:16.868381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:16.868695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:16.869110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:17.253516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:17.261624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f77d0637-1056-468c-8433-89c41dc7fda5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.406401 Oct 15 08:59:17.262209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 563/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:17.383846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:17.385983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:17.392398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:17.392880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:17.393319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:17.394055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:17.394515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:17.394941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:17.425817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e34b3b06-901b-4c0c-bfa7-2ffcde2bc83f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045929 Oct 15 08:59:17.426366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 566/1129] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:18.284788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:18.285496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:18.293235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:18.293758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:18.294200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:18.294908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:18.295366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:18.295791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:18.422749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:18.424905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:18.432173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cc2bc66b-4dea-4961-9665-2357f6bd2a9a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151723 Oct 15 08:59:18.432740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 564/1130] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:18.438313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:18.440469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:18.447027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:18.447493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:18.447931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:18.448614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:18.449072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:18.449495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:18.479470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8189aab-3747-4cb1-ace7-4775ee4d38c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Oct 15 08:59:18.480010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 567/1131] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:19.454636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:19.455275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:19.462454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:19.462872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:19.463299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:19.463977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:19.464423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:19.464838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:19.491481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:19.493599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:19.500020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:19.500499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:19.500923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:19.501607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:19.502079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:19.502498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:19.532635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b1d8432e-4f6b-4955-9c28-1a58c01ee722 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Oct 15 08:59:19.533192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 568/1132] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:19.594898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:19.603103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-230c4241-01d3-4a98-aae7-598a50ef80c4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152332 Oct 15 08:59:19.603669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 565/1133] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:20.545325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:20.547418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:20.553754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:20.554224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:20.554654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:20.555337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:20.555781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:20.556199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:20.585494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-62f00fb4-727d-49b4-be6a-f953e55dba6c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Oct 15 08:59:20.586056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 569/1134] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:20.625810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:20.626423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:20.632840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:20.633311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:20.633830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:20.634510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:20.634956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:20.635370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:20.759217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:20.767381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2f4c51ed-b4b2-4110-a972-7e14b6ea1579 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145357 Oct 15 08:59:20.767950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 566/1135] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:21.597254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:21.599852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:21.606427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:21.606934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:21.607355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:21.608042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:21.608499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:21.608921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:21.638176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e0870f20-cfda-4cf6-ae9a-4ed296ab90db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Oct 15 08:59:21.638712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 570/1136] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:21.790570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:21.791190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:21.797591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:21.798106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:21.798543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:21.799229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:21.799686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:21.800118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:21.927889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:21.935998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb37d40b-f86d-4991-a1ad-22b1cfacf156 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149194 Oct 15 08:59:21.936568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 567/1137] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:21 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:22.651087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:22.653185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:22.659786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:22.660249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:22.660677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:22.661347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:22.661818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:22.662830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:22.688947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:22.694203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a139e753-579b-43d5-bf00-cf899e206117 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Oct 15 08:59:22.694752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 571/1138] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:22.959469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:22.960027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:22.966425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:22.966909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:22.967341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:22.968022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:22.968473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:22.968896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:23.092833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:23.101449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b4af6ce0-b919-4328-bab5-5290200be254 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146020 Oct 15 08:59:23.102043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 568/1139] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:22 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:23.706772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:23.708911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:23.715260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:23.715745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:23.716179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:23.716864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:23.717319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:23.717770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:23.746655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1638997c-cbe6-4c23-83b6-ccf7717a1536 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Oct 15 08:59:23.747194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 572/1140] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:24.124449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:24.125018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:24.131538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:24.132015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:24.132446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:24.133124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:24.133577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:24.134025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:24.260188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:24.268651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9f4e0d82-5da6-4b85-b0fd-9414e3158eb5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148228 Oct 15 08:59:24.269216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 569/1141] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:24.759482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:24.761647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:24.767963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:24.768466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:24.768902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:24.769576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:24.770055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:24.770474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:24.799542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-357f722e-1315-434c-acce-cdeaa1f39445 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Oct 15 08:59:24.800077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 573/1142] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:25.292664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:25.293217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:25.299515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:25.299991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:25.300418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:25.301097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:25.301544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:25.301985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:25.433454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:25.441526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8a97a66c-6ac9-4a10-b2e9-e7013a234c1d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152752 Oct 15 08:59:25.442112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 570/1143] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:25.811767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:25.813942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:25.820262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:25.820740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:25.821173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:25.821889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:25.822343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:25.822766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:25.852128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ac9c7cdc-140b-4204-b389-5804f51a7449 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Oct 15 08:59:25.852603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 574/1144] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:26.464720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:26.465489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:26.471896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:26.472369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:26.472794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:26.473470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:26.473945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:26.474364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:26.603992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:26.612131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8fd09f5-56fe-45a0-a357-dd67505426af tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151347 Oct 15 08:59:26.612691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 571/1145] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:26.864393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:26.867103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:26.873404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:26.873912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:26.874346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:26.875047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:26.875493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:26.875909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:26.903991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b7ac52da-77ce-4dc0-966b-e6ce2273d59d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Oct 15 08:59:26.904525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 575/1146] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:27.634100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:27.634713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:27.641302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:27.641807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:27.642233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:27.642917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:27.643368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:27.643783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:27.777350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:27.785734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a967b33f-c333-494a-96df-c9d861ef80b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.155474 Oct 15 08:59:27.786295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 572/1147] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:27 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:27.916910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:27.918997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:27.925263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:27.925774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:27.926210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:27.926888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:27.927339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:27.927759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:27.956662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e0d4a0dd-0a30-4193-8b12-f5bded34df28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 15 08:59:27.957211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 576/1148] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:28.808629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:28.809180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:28.815521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:28.815993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:28.816420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:28.817094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:28.817566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:28.818012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:28.942777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:28.951457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-474c034a-41eb-47f5-812c-ba16743db045 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146652 Oct 15 08:59:28.952223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 573/1149] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:28 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:28.968773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:28.971015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:28.978082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:28.978561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:28.978994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:28.979678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:28.980128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:28.980549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:29.009390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-df778e79-8468-4e5a-acc7-0fb05b5fd46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Oct 15 08:59:29.009966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 577/1150] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:29.974466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:29.975089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:29.981727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:29.982224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:29.982660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:29.983356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:29.983812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:29.984234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:30.022140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:30.024295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:30.030667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:30.031148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:30.031588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:30.032562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:30.032741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:30.033194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:30.064304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6df0150d-5fce-4ba7-a259-d2c44492a1bd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Oct 15 08:59:30.064874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 578/1151] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:30.114275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:30.122991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-19fddeab-fbaa-4364-8649-4b66b73d9108 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152464 Oct 15 08:59:30.123556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 574/1152] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:29 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:31.078866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:31.081146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:31.088164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:31.088639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:31.089069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:31.089814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:31.090266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:31.090684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:31.119621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9b19a3f7-d72b-4b1d-9fdc-243628735a4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Oct 15 08:59:31.120157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 579/1153] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:31.146959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:31.147577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:31.153954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:31.154428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:31.154855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:31.155528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:31.155973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:31.156386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:31.284805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:31.292878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-43867ec8-e730-4a36-ae34-8e2084ce644e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150259 Oct 15 08:59:31.293597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 575/1154] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:32.132103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:32.134202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:32.140493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:32.140960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:32.141383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:32.142091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:32.142535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:32.142949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:32.171847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-668ee8f5-e238-43b1-a065-cfd3c1dbf185 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Oct 15 08:59:32.172376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 580/1155] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:32.314706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:32.315316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:32.321750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:32.322224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:32.322649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:32.323322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:32.323769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:32.324186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:32.452542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:32.461326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d6b943ab-6c46-4cf9-8587-1f0e04cc9b42 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150385 Oct 15 08:59:32.461940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 576/1156] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:59:33.394967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:33.397957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:33.403865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:33.404345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:33.404775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:33.405462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:33.405943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:33.406366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:33.435680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f14bd5aa-a9bf-4019-8fdf-1f7b138f784e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.255575 Oct 15 08:59:33.436227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 581/1157] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:33.485408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:33.485987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:33.492394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:33.492871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:33.493299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:33.494005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:33.494455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:33.494874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:33.621696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:33.629840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6addc0fc-0924-49c4-9446-21b63433f5e4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148240 Oct 15 08:59:33.630904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 577/1158] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:34.448602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:34.450776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:34.457119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:34.457602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:34.458149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:34.459671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:34.460129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:34.460577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:34.489281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3fa5647-3b23-484a-a79f-bff78884ce17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Oct 15 08:59:34.489873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 582/1159] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:34.652908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:34.653454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:34.660218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:34.660695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:34.661127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:34.661968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:34.662423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:34.662845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:34.790862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:34.798940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ebab8078-c83d-4350-a37c-78678ed21c71 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149926 Oct 15 08:59:34.799494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 578/1160] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:34 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:35.501684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:35.503848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:35.510175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:35.510649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:35.511072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:35.511743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:35.512185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:35.512599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:35.542470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8e675526-6584-4725-aafe-b6e36b3d1e78 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Oct 15 08:59:35.543015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 583/1161] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:35.822467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:35.823082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:35.829538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:35.830062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:35.830491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:35.831175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:35.831627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:35.832048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:35.960058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:35.968104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d6780cc0-8f5b-42d7-bb67-ac2f79d29608 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149960 Oct 15 08:59:35.968666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 579/1162] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:36.554689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:36.556819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:36.562706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:36.563182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:36.563614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:36.564290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:36.564737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:36.565154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:36.593438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5834beb8-351e-4c48-adef-24517a882f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Oct 15 08:59:36.594000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 584/1163] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:36.991235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:36.991848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:36.998313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:36.998794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:36.999258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:36.999950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:37.000398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:37.000819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:37.131149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:37.139437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b895f701-9b2d-4826-8697-1c868f4222bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152486 Oct 15 08:59:37.140005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 580/1164] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:36 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:37.606301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:37.608484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:37.615457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:37.615936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:37.616372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:37.617057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:37.617539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:37.617991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:37.647046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7ff59320-b0c0-4940-9ec9-db45ed58e476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Oct 15 08:59:37.647578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 585/1165] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:38.162597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:38.163073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:38.169670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:38.170174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:38.170601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:38.171287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:38.171740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:38.172145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:38.186841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:38.300520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:38.308599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f8635397-d8cf-485c-9020-6cd1e9bf131c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150297 Oct 15 08:59:38.309163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 581/1166] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:38.659598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:38.661737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:38.668044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:38.668516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:38.668941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:38.669614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:38.670085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:38.670503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:38.699766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9a8b3855-6321-4cc6-a15a-c09fdc243018 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Oct 15 08:59:38.700298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 586/1167] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:39.331886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:39.332503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:39.338943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:39.339415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:39.339843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:39.340549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:39.340998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:39.341417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:39.470549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:39.478899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca31e33c-f43e-48f9-9e16-7abdd55f4df4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150803 Oct 15 08:59:39.479473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 582/1168] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:39.711975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:39.714151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:39.720854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:39.721271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:39.721716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:39.722390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:39.722833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:39.723249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:39.752699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c3b1d482-c22a-41ba-946b-bb4e6ef2420d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Oct 15 08:59:39.753226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 587/1169] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:40.502231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:40.502845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:40.509839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:40.510318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:40.510751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:40.511433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:40.511889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:40.512311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:40.637706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:40.645912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-905c4f00-ae9d-4147-ac40-56a58c83d797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147534 Oct 15 08:59:40.646480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 583/1170] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:40.765461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:40.767633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:40.774375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:40.774842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:40.775264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:40.775940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:40.776382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:40.776801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:40.791630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:40.807702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aca5eb5a-e752-40ae-af56-4fd3bdfacfdb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046118 Oct 15 08:59:40.808246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 588/1171] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:41.668320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:41.668886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:41.675250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:41.675724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:41.676154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:41.676827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:41.677807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:41.678224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:41.806629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:41.814705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-01a1b9db-f043-4c24-8d0e-24fd2029bdc9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150236 Oct 15 08:59:41.815259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 584/1172] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:41 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:41.819448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:41.821601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:41.827925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:41.828406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:41.828839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:41.829522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:41.830007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:41.830426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:41.859092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9850690b-c2ce-4f00-89b7-faa204a0ad7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Oct 15 08:59:41.859633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 589/1173] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:42.837890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:42.838507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:42.844816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:42.845295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:42.845762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:42.846446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:42.846898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:42.847318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:42.871516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:42.873670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:42.880698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:42.881186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:42.881613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:42.882319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:42.882790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:42.883208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:42.912594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aa8d1a10-a31d-4ba8-a863-3674b8df5a0b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Oct 15 08:59:42.913137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 590/1174] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:42.975175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:42.983294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c6f1269a-0d5d-44cb-b64e-2e948b0d321c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149859 Oct 15 08:59:42.983854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 585/1175] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:43.405760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:43.406256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:43.412337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.412811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.413238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.413939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.414389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.414806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.439296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 08:59:43.516206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4daba9d3-f315-419e-b7db-ce20deb7058c tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 204 len: 0 microversion: 2.1 time: 0.113932 Oct 15 08:59:43.516884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 591/1176] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 08:59:43 2022] DELETE /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 08:59:43.525849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:43.526546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:43.532970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.533437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.533897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.534845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.535313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.535866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.666081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:43.673607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-49d06490-23d2-42c2-b273-2fb0fd7e0bdd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1680 microversion: 2.1 time: 0.152409 Oct 15 08:59:43.674211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 586/1177] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:43 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:43.925066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:43.927878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:43.934248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.935992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.936432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.937122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:43.937574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:43.938020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:43.968435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fef5b0c5-869a-46a7-91be-289122d40e9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047669 Oct 15 08:59:43.968993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 592/1178] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:44.007010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:44.007620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:44.013922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.014403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.014835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:44.015514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.015963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.016382 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:44.245866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:44.265966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7c0bed70-89e5-4a8d-8136-561bebd3ce86 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.251971 Oct 15 08:59:44.266655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 587/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:44.696505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:44.697144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:44.703212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.703692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.704122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:44.704809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.705259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.705701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:44.773742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:44.782061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8c48ac9a-9465-411a-85de-89bade7f4236 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 200 len: 1613 microversion: 2.1 time: 0.089467 Oct 15 08:59:44.783022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 593/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:44 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 1613 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:44.823475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d591419c-18a4-4e6b-a087-d9a2b4edaf8f", "name": "network-vif-deleted", "tag": "31414928-82a8-4928-adbe-1352569c1769"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:59:44.828427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=54 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:44.836463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.836994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.837917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:44.850300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] Creating event network-vif-deleted:31414928-82a8-4928-adbe-1352569c1769 for instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f on hv-cinder-85697 Oct 15 08:59:44.856669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-10fbe87f-e43a-4b46-b2dc-7adf11d6cb2f req-32813706-4970-4da7-b82d-bcb21828fca8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036867 Oct 15 08:59:44.857377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 588/1181] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:44.981479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:44.984528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:44.992702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:44.993536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:44.994230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.007654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:45.008064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:45.008589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.063421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-39413e55-4e62-45e4-bf2c-43b2e2e33f25 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086759 Oct 15 08:59:45.069441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 594/1182] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:45.289483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:45.290200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:45.296894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:45.297552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:45.298008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.298694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:45.299141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:45.299559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.431718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:45.440656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe4ca221-2693-43c3-a1e6-e1bbf9ae51f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.155997 Oct 15 08:59:45.441318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 589/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:45.806836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:45.807528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:45.809603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:45.814983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:45.815459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:45.815888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.816572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:45.817019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:45.817434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:45.832305 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f HTTP/1.1 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 08:59:45.834024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 08:59:45.835685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': 'd591419c-18a4-4e6b-a087-d9a2b4edaf8f'} Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 08:59:45.836635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 08:59:45.838197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 08:59:45.839882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 08:59:45.839882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6dc986e7-739a-4fa6-8704-6b0ca292a229 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 404 len: 111 microversion: 2.1 time: 0.033402 Oct 15 08:59:45.839882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 595/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:45 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 08:59:45.844138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f104b526-5df9-46da-b855-4961279b9390 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '.version_select at 0x7f575aa1eee0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:45.848522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f104b526-5df9-46da-b855-4961279b9390 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [49bf738f-fd57-4e09-9d69-0c4cf0477311] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 08:59:46.076426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:46.078623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:46.085388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:46.085900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:46.086385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:46.087065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:46.087669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:46.088092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:46.119705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0ae55951-82d1-4faa-baca-55d9c69a8f9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 Oct 15 08:59:46.120234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 596/1185] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:46.464721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:46.465423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:46.471282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:46.471750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:46.472172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:46.472853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:46.473301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:46.473739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:46.597789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:46.605871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1d4f5fd7-0297-454e-874c-0cd22ced2210 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.144990 Oct 15 08:59:46.606435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 597/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:59:46.855530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-f104b526-5df9-46da-b855-4961279b9390 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [49bf738f-fd57-4e09-9d69-0c4cf0477311] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 47538. Oct 15 08:59:46.873312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f104b526-5df9-46da-b855-4961279b9390 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-789283564" status: 202 len: 0 microversion: 2.1 time: 1.032890 Oct 15 08:59:46.873996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 590/1187] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 08:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-789283564 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 08:59:47.132909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:47.135360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:47.142519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:47.143084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:47.143586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:47.144348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:47.144887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:47.145379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:47.183535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-79ac0d70-6d79-4b24-87b6-b9371df06650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055100 Oct 15 08:59:47.184620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 598/1188] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:47.628762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ee2fe442-086d-4d4f-8620-58e143cd3a22 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: .version_select at 0x7f575e56c8b0>, body: {"keypair": {"name": "tempest-keypair-165985739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBacbtGJORkP8VoIA3OedLjtPInZf0xllzl/kjla8iQwgoit3x5dQ043fpB0IBICf+L90sJkpzyJBovDr8X/dvCSUHFyPkkxkY6a1ZVw5/b1vj5H3lmrNy2bHy1MBv3jzg=="}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:59:47.629400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:47.630706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:47.637639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:47.638142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:47.638639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:47.639428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:47.639946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:47.640429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:47.644318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-ee2fe442-086d-4d4f-8620-58e143cd3a22 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:59:47.648319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-ee2fe442-086d-4d4f-8620-58e143cd3a22 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:59:47.670428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ee2fe442-086d-4d4f-8620-58e143cd3a22 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045154 Oct 15 08:59:47.671040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 599/1189] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 08:59:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:47.775197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:47.784914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ba2d9a00-08c1-4adc-964d-b089c266e5f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.159673 Oct 15 08:59:47.799459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 591/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:47 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:48.195587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:48.197836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:48.204987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:48.205493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:48.205971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:48.206686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:48.207163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:48.207581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:48.238163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-19e3f3ea-de39-4433-8c13-178859314fbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046439 Oct 15 08:59:48.238715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 600/1191] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:48.798393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653405346", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "abd5286e-7177-474d-b9f2-9ade4753e5ec"}], "security_groups": [{"name": "tempest-securitygroup--1234793183"}], "key_name": "tempest-keypair-165985739", "user_data": "}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:59:48.810317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:48.810929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:48.816687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:48.817168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:48.818128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:48.818910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:48.819271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:48.819697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:48.835776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 08:59:48.836123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 08:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 (ip 10.222.0.30) !!! Oct 15 08:59:48.957863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] validate_networks() for [('abd5286e-7177-474d-b9f2-9ade4753e5ec', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 08:59:49.032458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:49.041082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c4775ff1-4854-4d25-82cc-b3d8572dcb0c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.234850 Oct 15 08:59:49.041668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 601/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:48 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:59:49.250724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:49.252908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:49.260102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:49.260584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:49.261018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:49.261725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:49.262185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:49.262606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:49.292480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b29e82dc-1773-4382-896a-7aee3db914fb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Oct 15 08:59:49.293031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 602/1193] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:49.386905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 08:59:49.387348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 08:59:49.387819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 08:59:49.388221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 08:59:49.388627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 08:59:49.397443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:49.397953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:49.398496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:49.399218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:49.399672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:49.400091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:49.417374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 08:59:49.421328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Getting quotas for user 060d1fae9b0b488da1f7553cabd97d28 and project ca38c1109acc49849daeb555b673e756. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 08:59:49.433065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 08:59:49.435391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 08:59:49.482376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [6810e88e-90be-408b-91cb-6e5460c1e935] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 08:59:50.064871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:50.065483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:50.071564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:50.072047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:50.072479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:50.073159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:50.073612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:50.074076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:50.202745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:50.211105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-47e06391-68dc-40d1-a741-9986db7d0bff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150034 Oct 15 08:59:50.211662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 603/1194] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:59:50.305361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:50.307544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:50.313945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:50.314427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:50.314863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:50.315549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:50.316000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:50.316424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:50.345012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f673b81d-473d-466c-a9fb-1d6346808fdd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044210 Oct 15 08:59:50.345556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 604/1195] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:50.489588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [6810e88e-90be-408b-91cb-6e5460c1e935] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 47606. Oct 15 08:59:50.493478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-891775b4-0fc9-44ad-9663-7e353f806005 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.699426 Oct 15 08:59:50.494163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 592/1196] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 08:59:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 08:59:50.505152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-39c70e3c-b47d-4dee-8905-8ea263f3cc37 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:50.505790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-39c70e3c-b47d-4dee-8905-8ea263f3cc37 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:50.562325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-39c70e3c-b47d-4dee-8905-8ea263f3cc37 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:50.573607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-39c70e3c-b47d-4dee-8905-8ea263f3cc37 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1240 microversion: 2.1 time: 0.072297 Oct 15 08:59:50.574712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 605/1197] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:50 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:51.235388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:51.236006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:51.245141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.245640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.246104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.247333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.247794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.248250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.358668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:51.361006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:51.369791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.370275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.370796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.371872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.372511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.372936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.376706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:51.386086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:51.397172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ec701e83-0b96-4c91-8e2a-be8ccf723c39 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.166490 Oct 15 08:59:51.397783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 593/1198] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:51.408446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7f94f36c-2aac-4b79-affa-6c296aa0de30 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054764 Oct 15 08:59:51.409096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 606/1199] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:51.597377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:51.598037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:51.604429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.604937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.605372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.606090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:51.606543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:51.606963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:51.671308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:51.679576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b9c8519e-7df2-405e-8369-b2d9a60a1d2e tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1292 microversion: 2.1 time: 0.085999 Oct 15 08:59:51.680133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 594/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:51 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:52.420950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:52.421709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:52.421885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:52.424340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:52.429317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.429833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.430447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.431160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.431841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.432280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.432438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.433113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.433543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.434259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.434864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.435443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.479882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86c546dd-530d-4d26-8e81-c51286aaa83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062015 Oct 15 08:59:52.480407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 595/1201] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:52.655452 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:52.666382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1ce962db-71ca-4ffe-ad94-e22c0354c289 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.249666 Oct 15 08:59:52.667039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 607/1202] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:52.702809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:52.703421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:52.716337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.717337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.719104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.720002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:52.720996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:52.735321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:52.948900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:52.956777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6262ad5d-9804-4238-9317-6b305449f5b8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.258052 Oct 15 08:59:52.957441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 596/1203] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:52 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:53.493327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:53.495696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:53.502392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.502857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.503290 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.503983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.504434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.505435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.511581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82548603-b8ab-4ea8-8a18-eb7587a9f224", "tag": "27000bb8-a32b-4e47-a8d0-6d7e704fc838"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:59:53.524225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.524704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.525131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.540659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] Creating event network-changed:27000bb8-a32b-4e47-a8d0-6d7e704fc838 for instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 on hv-cinder-85697 Oct 15 08:59:53.545602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-30a726a4-fb8a-422d-8395-bb04e968c4f7 req-a7e471eb-b23a-462f-a458-4fdc881e74d8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 Oct 15 08:59:53.546462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 597/1204] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:53.551048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a376a9a1-3dc9-48dd-b596-0ac8af8721ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062270 Oct 15 08:59:53.552116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 608/1205] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:53.690446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:53.691075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:53.698123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.698604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.699035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.699731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.700185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.700601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.905201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:53.914253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-26ca7ecc-a8ed-42c7-8ad8-29744841807b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.228351 Oct 15 08:59:53.914829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 598/1206] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:53.980473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:53.981207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:53.987082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.987565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.987988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:53.988670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:53.989764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:53.990186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:54.121617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:54.129217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e048f16e-774b-4255-9786-cd0208e827f3 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.152548 Oct 15 08:59:54.129853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 609/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:53 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:54.564121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:54.566211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:54.573214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:54.573721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:54.574163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:54.574841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:54.575291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:54.575710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:54.605362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9031a7a5-2eb1-4a25-9514-3249dcf2f26f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045352 Oct 15 08:59:54.605953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 599/1208] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:54.937165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:54.937793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:54.944877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:54.945350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:54.945808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:54.946485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:54.946930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:54.947344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:55.151570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:55.152268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:55.158313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:55.158699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:55.159126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:55.160073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:55.160515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:55.160935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:55.166009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:55.174547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3b86fa3d-dda3-4aae-977a-6096e0ac4689 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.241265 Oct 15 08:59:55.175108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 610/1209] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:54 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:55.362779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:55.371679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-27b5ac03-b7d9-4e7e-b80c-f81f663b97f1 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.223950 Oct 15 08:59:55.372686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 600/1210] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:55 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 08:59:55.618027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:55.620210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:55.626089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:55.626564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:55.626992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:55.627670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:55.628114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:55.628566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:55.657264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-48477220-c7f5-4597-95d1-67ff3703162a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 Oct 15 08:59:55.657839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 611/1211] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:56.198183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:56.198722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:56.205132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.205613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.206070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.206787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.207241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.208152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.210288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:56.337331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:56.345432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8171811a-87a3-487d-b98f-8a02bb6c9f47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151183 Oct 15 08:59:56.346099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 601/1212] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:56.399385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:56.399991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:56.406775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.407252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.407694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.408344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.408797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.409471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.536729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:56.544231 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-55454e68-e818-4462-9e1f-e4fa9af7bccd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.149323 Oct 15 08:59:56.544779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 612/1213] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:56 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:56.670445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:56.672715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:56.679299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.679785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.680222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.681044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:56.681714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:56.681965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:56.711939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4a811f79-b160-410b-b142-6a26e99e31db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Oct 15 08:59:56.712501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 602/1214] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:57.369942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:57.370555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:57.376359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.376862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.377400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.378113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.378571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.378980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.514308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:57.523172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b3a7d0ea-f4e1-4b1e-8aa2-5f42ddeedfb9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.157105 Oct 15 08:59:57.523732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 613/1215] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:57.566592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:57.567774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:57.574153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.574636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.575089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.575754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.576207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.576628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.704654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:57.713181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e5015c78-b202-4a46-b270-fa3dfd8384c4 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.150346 Oct 15 08:59:57.713832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 603/1216] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:57 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:57.724328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:57.726503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:57.732382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.732858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.733285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.734273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:57.734793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:57.735279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:57.764855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-301e8175-ec01-4714-b916-250608683a1e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044530 Oct 15 08:59:57.765631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 614/1217] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:58.553852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:58.553852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:58.553852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.554391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.554898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.555660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.556184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.556715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.681819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:58.689951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-523dcb5e-74db-4108-9f0d-5fdbe6c02727 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147607 Oct 15 08:59:58.690653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 604/1218] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:58.735550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:58.736156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:58.742487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.742957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.743383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.744056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.744505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.744924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.777022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:58.779330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:58.788744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.788744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.788744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.788744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:58.789352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:58.789352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:58.819414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d81c882e-789c-4c6c-8b98-abf64b816325 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046205 Oct 15 08:59:58.819992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 605/1219] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:58.876501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:58.884711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e875adcd-d401-459f-aac4-05116e6246d8 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.152988 Oct 15 08:59:58.885256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 615/1220] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:58 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:59.398389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82548603-b8ab-4ea8-8a18-eb7587a9f224", "name": "network-vif-plugged", "status": "completed", "tag": "27000bb8-a32b-4e47-a8d0-6d7e704fc838"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 08:59:59.406742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:59.408835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.409581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.410034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.421548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] Creating event network-vif-plugged:27000bb8-a32b-4e47-a8d0-6d7e704fc838 for instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 on hv-cinder-85697 Oct 15 08:59:59.427075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-21daa9b4-b6f9-43fa-8f77-04648990a392 req-861c8e78-bb99-48ec-bdd3-8507be2d3f7a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095247 Oct 15 08:59:59.427656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 606/1221] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 08:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 08:59:59.712674 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:59.713274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:59.719200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.719681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.720115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.720799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.721252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.721701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.828789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 08:59:59.833871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:59.836273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:59.842781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.843267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.843700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.844394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.844844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.845269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.850244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 08:59:59.858369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7cfe7d51-4b1e-48db-b647-578800fec2f1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149514 Oct 15 08:59:59.858924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 616/1222] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:59 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 08:59:59.875868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-255480e5-2f77-453a-8d8b-443f4a1617d0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Oct 15 08:59:59.876411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 607/1223] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 08:59:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 08:59:59.906848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 08:59:59.907455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 08:59:59.914238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.914716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.915151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 08:59:59.915829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 08:59:59.916314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 08:59:59.916733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:00.045206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:00.052891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a8817a1b-ddb5-4765-9904-8a9b4d6747f7 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1366 microversion: 2.1 time: 0.149707 Oct 15 09:00:00.053455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 617/1224] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 08:59:59 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:00.882026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:00.882681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:00.887898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:00.889042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:00.889520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:00.889981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:00.890138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:00.890665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:00.891114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:00.891534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:00.892050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=6 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:00.898460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:00.898951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:00.899377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:00.900065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:00.900514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:00.900937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:00.930977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-97d86ee2-3e80-49f3-a747-ae1e7a8e2183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046868 Oct 15 09:00:00.931784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 618/1225] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:00:01.021879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:01.029995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-33d97259-2019-4752-8495-c74d77ee1966 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151906 Oct 15 09:00:01.030556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 608/1226] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:00 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:01.078003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:01.078646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:01.084687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.085182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.085612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.086486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.086947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.087366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.214477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:01.222044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2af2e356-1842-4b65-a273-5e81bc490f52 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1556 microversion: 2.1 time: 0.148387 Oct 15 09:00:01.222620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 619/1227] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:01 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:01.244351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:01.244680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:01.250677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.251157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.251584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.252266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.252716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.253136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.327997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a44ab4c7-1876-4aad-96ea-634fe59302cd tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087554 Oct 15 09:00:01.328632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 609/1228] 10.222.0.30 () {58 vars in 1275 bytes} [Sat Oct 15 09:00:01 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:01.944642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:01.947117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:01.953358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.953869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.954303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.954986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:01.955456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:01.955876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:01.984689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-62023562-a247-4b10-aa78-f0ea5828cf9f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Oct 15 09:00:01.985238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 620/1229] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:02.053984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:02.054718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:02.060776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:02.061333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:02.061891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:02.062645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:02.063172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:02.063666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:02.272831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:02.283393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-928bddbc-cc02-4872-bf57-4a26814d4595 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.234472 Oct 15 09:00:02.283970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 610/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:02 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:02.315130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82548603-b8ab-4ea8-8a18-eb7587a9f224", "tag": "27000bb8-a32b-4e47-a8d0-6d7e704fc838"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:00:02.324337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:02.324886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:02.325383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:02.336649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] Creating event network-changed:27000bb8-a32b-4e47-a8d0-6d7e704fc838 for instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 on hv-cinder-85697 Oct 15 09:00:02.341792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-4b43045e-53d6-423a-91e9-4b435dfb1883 req-f596fb4f-c7de-464b-a5e4-bdb04b63b06c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030204 Oct 15 09:00:02.342384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 621/1231] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:00:02.997700 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:03.000002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:03.006697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:03.007122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:03.007558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:03.008276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:03.008731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:03.009161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:03.039137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e934b1ce-3e1e-4cdc-8207-67fbdebff04a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045489 Oct 15 09:00:03.039701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 611/1232] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:03.311712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:03.312410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:03.319378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:03.319862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:03.320295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:03.320989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:03.321441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:03.321894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:03.460676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:03.468859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f3340869-928c-48ca-818f-83795ba5451d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.161765 Oct 15 09:00:03.469453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 622/1233] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:04.051569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:04.053733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:04.060211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:04.060685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:04.061114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:04.061836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:04.062286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:04.062704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:04.092412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-71324e4e-e100-466a-8c74-db39845b5e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Oct 15 09:00:04.092960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 612/1234] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:04.492405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:04.493008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:04.499449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:04.499918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:04.500346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:04.501019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:04.501464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:04.501917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:04.516405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:04.630673 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:04.638779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5ff943a9-4571-4cc1-ace3-4b13be1ae5c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150853 Oct 15 09:00:04.639332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 623/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:05.104505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:05.106651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:05.112975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:05.113457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:05.113981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:05.114665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:05.115119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:05.115542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:05.144458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b2f9208f-00a3-4e0d-b051-529655aa4f0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043961 Oct 15 09:00:05.145665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 613/1236] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:05.662702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:05.663265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:05.669604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:05.670113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:05.670546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:05.671230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:05.671679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:05.672104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:05.796135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:05.805450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c081e0ef-71da-4392-ae04-5ef275fd55db tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146928 Oct 15 09:00:05.806059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 624/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:06.157259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:06.159663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:06.166680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:06.167102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:06.167529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:06.168203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:06.168647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:06.169063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:06.197822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-59845974-c8ea-4be4-bbb4-beac5a96b854 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044427 Oct 15 09:00:06.198374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 614/1238] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:06.828388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:06.829016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:06.835546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:06.836023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:06.836456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:06.837136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:06.837585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:06.838043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:06.967746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:06.976046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f45b0e18-ea60-4825-a882-73d9e6cea271 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151620 Oct 15 09:00:06.976637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 625/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:07.210267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:07.212348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:07.218523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:07.219009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:07.219444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:07.220130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:07.220585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:07.221007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:07.249999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e9fe4a29-6109-4bb7-abe7-7e668ac2d75b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Oct 15 09:00:07.250551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 615/1240] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:07.999126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:07.999735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:08.007011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:08.007481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:08.007908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:08.008587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:08.009032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:08.009449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:08.135414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:08.143722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b8ffe7da-027d-4505-af02-8c0d8eda4991 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148218 Oct 15 09:00:08.144353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 626/1241] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:07 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:08.263151 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:08.265407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:08.271846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:08.272327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:08.272760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:08.273447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:08.273930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:08.274355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:08.305866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9f13b666-2668-4d6e-ae46-66cf97d83aac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Oct 15 09:00:08.306432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 616/1242] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:09.167378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:09.167983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:09.174450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:09.174926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:09.175352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:09.176032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:09.176477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:09.176892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:09.304625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:09.312962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-13637677-64c6-4fd4-aa0c-e5f687657490 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149302 Oct 15 09:00:09.313549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 627/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:09.318333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:09.320472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:09.326857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:09.327332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:09.327763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:09.328449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:09.328901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:09.329325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:09.358778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-11baffcb-7713-4256-8c0e-bba106ae8c64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Oct 15 09:00:09.359320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 617/1244] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:10.336042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:10.336599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:10.343047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:10.343521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:10.343948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:10.344623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:10.345066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:10.345483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:10.370997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:10.373260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:10.379873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:10.380353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:10.380785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:10.381475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:10.381969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:10.382396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:10.407969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:10.414340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3079645d-a04c-4c80-bf25-96e7355f5d65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047223 Oct 15 09:00:10.414938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 618/1245] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:00:10.471478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:10.480247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8cf651d-9dfa-49d0-b510-f9f433a801da tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148221 Oct 15 09:00:10.480809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 628/1246] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:11.425851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:11.428024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:11.434734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:11.435213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:11.435644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:11.436330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:11.436783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:11.437207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:11.466793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-06389263-30f2-4b60-b664-d76f79c08a9b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044952 Oct 15 09:00:11.467333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 619/1247] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:11.503889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:11.504501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:11.511103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:11.511586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:11.512171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:11.512711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:11.513168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:11.513598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:11.642008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:11.650886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9d50ff93-c2c3-4f05-9fa4-6ac3372594ea tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150900 Oct 15 09:00:11.651744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 629/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:12.479774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:12.481960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:12.488504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:12.488982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:12.489413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:12.490121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:12.490610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:12.491028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:12.521592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f3349f4d-a8a6-44db-bd44-9a7cd01386c8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Oct 15 09:00:12.522190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 620/1249] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:12.674459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:12.675104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:12.681440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:12.681962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:12.682390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:12.683072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:12.683521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:12.683957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:12.813730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:12.822321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-47818520-0617-4a6c-bf0f-51d7a32d2e77 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151761 Oct 15 09:00:12.822879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 630/1250] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:13.534442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:13.536606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:13.544266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:13.544752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:13.545187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:13.545922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:13.546379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:13.546809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:13.581659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-923df2c3-1bdf-4924-9d87-6d5007bf9b65 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051524 Oct 15 09:00:13.582881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 621/1251] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:13.845381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:13.846015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:13.852294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:13.852770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:13.853199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:13.853910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:13.854358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:13.854778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:13.978459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:13.986525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f6119dab-c181-489d-ba42-8aa68585e6f0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.144921 Oct 15 09:00:13.987082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 631/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:14.594818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:14.596925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:14.603942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:14.604425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:14.604862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:14.605554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:14.606037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:14.606461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:14.635431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2391c0db-7a15-4536-8142-76742294ee43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Oct 15 09:00:14.635973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 622/1253] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:15.010361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:15.011006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:15.017346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:15.017859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:15.018294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:15.018983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:15.020056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:15.020531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:15.150602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:15.158638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4683059d-4342-4301-b137-6eb8f51b26aa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152167 Oct 15 09:00:15.159453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 632/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:15.648524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:15.650603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:15.652851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:15.658131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:15.658607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:15.659032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:15.660459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:15.660908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:15.661323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:15.691394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f384d868-3861-41ce-b5bf-ceca1b2d0b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Oct 15 09:00:15.691932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 623/1255] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:16.182206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:16.182816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:16.185108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:16.191086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:16.191594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:16.192027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:16.192713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:16.193161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:16.193583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:16.319206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:16.327224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-86b9054a-d677-429f-bb42-f3322b345bf3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148851 Oct 15 09:00:16.327772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 633/1256] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:16.703150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:16.705225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:16.711753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:16.712417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:16.713010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:16.713723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:16.714181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:16.714638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:16.743611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-edcb2ce3-352c-450c-a55b-176aabc4b017 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 Oct 15 09:00:16.744160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 624/1257] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:17.351208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:17.351821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:17.358222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:17.358699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:17.359129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:17.359812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:17.360265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:17.360715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:17.498136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:17.506526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4eafeb7a-e8ab-42c2-be2f-59d6c5ee5876 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.159569 Oct 15 09:00:17.507025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 634/1258] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:17.756148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:17.758374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:17.765032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:17.765509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:17.765975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:17.766658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:17.767106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:17.767523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:17.796552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-710d280b-da33-42d7-8579-f84f7225cf61 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044971 Oct 15 09:00:17.797085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 625/1259] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:18.529798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:18.530414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:18.537585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:18.538148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:18.538579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:18.539265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:18.539715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:18.540138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:18.665633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:18.673723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6c10bfd4-664a-4092-930e-a727db54fe2c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147779 Oct 15 09:00:18.674278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 635/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:18.809199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:18.811352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:18.817731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:18.818209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:18.818637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:18.819314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:18.819764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:18.820183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:18.849868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5b03c433-c9d4-445b-928f-5f21267e6aab tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Oct 15 09:00:18.850409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 626/1261] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:19.697081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:19.697602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:19.703946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:19.704417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:19.704844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:19.705522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:19.706001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:19.706423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:19.830788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:19.839344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c12d82cc-1638-447d-93b6-7c9fc0cc39f4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146168 Oct 15 09:00:19.839901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 636/1262] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:19.861390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:19.863588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:19.869988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:19.870473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:19.870910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:19.871598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:19.872055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:19.872477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:19.901132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2315bc98-7903-44e8-8ce3-f5f19045dcf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Oct 15 09:00:19.901697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 627/1263] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:20.863569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:20.864161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:20.870449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:20.870920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:20.871348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:20.872026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:20.872480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:20.872895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:20.914409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:20.916551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:20.923226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:20.923742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:20.924177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:20.924875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:20.925327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:20.926429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:20.955844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-68c4446f-32db-455e-be2e-b2b776d02b48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 Oct 15 09:00:20.956408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 628/1264] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:00:21.004578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:21.012793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b7d80179-5e6f-4377-baf3-7bb7d745e3ca tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153678 Oct 15 09:00:21.013348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 637/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:21.967990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:21.970090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:21.976517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:21.976995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:21.977429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:21.978148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:21.978634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:21.979059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:22.008641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9b44f68f-23d3-4a36-ac08-d86610dbfca1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Oct 15 09:00:22.009193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 629/1266] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:22.035722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:22.036332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:22.043024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:22.043543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:22.043979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:22.044666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:22.045120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:22.045542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:22.171238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:22.180126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a69ece1c-103a-40ad-9fdd-cc110d043748 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148464 Oct 15 09:00:22.180690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 638/1267] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:22 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:23.021387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:23.023541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:23.030010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:23.030481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:23.030909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:23.031581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:23.032026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:23.032441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:23.061102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8b61fb0-7ba0-45c6-958d-adc640fb331a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Oct 15 09:00:23.061649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 630/1268] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:23.202681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:23.203285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:23.210322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:23.210796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:23.211223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:23.211899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:23.212341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:23.212756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:23.589383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:23.597665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5444a59c-199c-49a0-86b8-92bea50e81bb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.398684 Oct 15 09:00:23.598239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 639/1269] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:23 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:24.073200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:24.075350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:24.081797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:24.082271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:24.082699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:24.083374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:24.083821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:24.084238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:24.113706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b36ec120-0909-4fac-915d-fb624f9f78fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Oct 15 09:00:24.114262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 631/1270] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:24.620829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:24.621458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:24.627812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:24.628282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:24.629204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:24.629899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:24.630346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:24.630759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:24.633213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:24.755471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:24.763685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7ddfc849-6dca-4149-b23c-23cfbd3d868f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146728 Oct 15 09:00:24.764239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 640/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:25.126073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:25.128328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:25.134695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:25.135177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:25.135610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:25.136293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:25.136746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:25.137165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:25.166927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-953721d4-d9e3-49fc-b992-06432ab0e007 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044936 Oct 15 09:00:25.167473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 632/1272] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:25.787527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:25.788144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:25.794547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:25.795022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:25.795453 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:25.796130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:25.796582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:25.797003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:25.930699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:25.938941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c877981d-3ef1-4c38-9357-cba0ed229c21 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.156200 Oct 15 09:00:25.939495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 641/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:26.179518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:26.181704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:26.188102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:26.188586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:26.189018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:26.189724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:26.190179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:26.190602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:26.220395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-40593042-ce5f-4696-ab4f-21dda99913f0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Oct 15 09:00:26.220945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 633/1274] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:26.961504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:26.962128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:26.968363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:26.968841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:26.969264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:26.970039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:26.970488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:26.970906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:27.095193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:27.103758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f0827fdf-fb35-4dcd-b567-d357963e8ff1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146129 Oct 15 09:00:27.104320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 642/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:27.232743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:27.234953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:27.241416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:27.241927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:27.242362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:27.243036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:27.243484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:27.243902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:27.275247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a4c04361-2bf0-448f-8736-e4760ca3ff0e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 Oct 15 09:00:27.275825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 634/1276] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:28.127490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:28.128118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:28.134661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:28.135137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:28.135564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:28.136244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:28.136721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:28.137167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:28.267004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:28.275781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e925e2d5-a88b-475d-97cf-fba23278ae50 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152080 Oct 15 09:00:28.276338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 643/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:28 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:28.287920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:28.290092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:28.297094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:28.297608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:28.298135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:28.299019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:28.299630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:28.300050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:28.314176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:28.330781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cc1d8703-6eba-4466-b36a-4616c1336337 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047637 Oct 15 09:00:28.331393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 635/1278] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:29.300025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:29.301350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:29.307684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:29.308159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:29.308583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:29.309258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:29.309726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:29.310150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:29.343824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:29.345985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:29.352893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:29.353372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:29.353832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:29.354523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:29.354975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:29.355392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:29.385961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c9ca5d7b-8678-45a8-8d96-0b9b56533ab6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045983 Oct 15 09:00:29.390144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 636/1279] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:00:29.436599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:29.444766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6184f7bd-a1ad-476e-8eca-3b08a7954823 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148532 Oct 15 09:00:29.445314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 644/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:29 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:30.398836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:30.400986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:30.407371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:30.407847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:30.408279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:30.408957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:30.409672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:30.410767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:30.439219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c3f4ea3a-fdce-4994-9b2f-002bd4e1f4ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Oct 15 09:00:30.439765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 637/1281] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:00:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:30.467656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:30.468264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:30.475255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:30.475738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:30.476171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:30.476853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:30.477304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:30.477751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:30.603660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:30.612211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c168bae8-29a1-4b20-a1eb-5b3ed8bf5263 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148358 Oct 15 09:00:30.612938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 645/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:30 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:31.451587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:00:31.453856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:31.460889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:31.461374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:31.461847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:31.462535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:31.462993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:31.463416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:31.541915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d793b785-84f2-4c22-b995-e675ef211b44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action" status: 200 len: 74844 microversion: 2.1 time: 0.093942 Oct 15 09:00:31.542493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 638/1283] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 09:00:31 2022] POST /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a/action => generated 74844 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 15 09:00:31.635627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:31.636230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:31.642527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:31.642999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:31.643424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:31.644099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:31.644542 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:31.644956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:31.774365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:31.782429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4354499b-6752-47f5-9090-b25d65247d16 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150632 Oct 15 09:00:31.782977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 646/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:32.806116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:32.806810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:32.813693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:32.814180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:32.814609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:32.815289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:32.815738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:32.816154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:32.943040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:32.951605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cc378da0-48aa-49f7-a1b7-06552f269fb0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149663 Oct 15 09:00:32.952162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 639/1285] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:33.975163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:33.975775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:33.982341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:33.982819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:33.983253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:33.983936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:33.984388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:33.984811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:34.113791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:34.121993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-74adb2ae-cf16-482a-b5c3-99da878c0b6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151227 Oct 15 09:00:34.122551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 647/1286] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:35.145306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:35.145946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:35.152376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:35.152852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:35.153294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:35.154010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:35.154457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:35.154872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:35.281188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:35.289922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2f318f21-710c-4afc-a786-d526435d02ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149008 Oct 15 09:00:35.290496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 640/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:36.312842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:36.313447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:36.320144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:36.320615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:36.321043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:36.321732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:36.322181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:36.322596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:36.454695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:36.463064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0382738e-24b3-42f9-82f6-03f739e451eb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154142 Oct 15 09:00:36.463613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 648/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:36 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:37.485882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:37.486496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:37.492855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:37.493334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:37.493786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:37.494473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:37.494920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:37.495339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:37.624483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:37.633169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4bbe5ba5-098c-407d-9ab3-56e53d7afba7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151135 Oct 15 09:00:37.633743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 641/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:37 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:38.260714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:38.261222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:38.267681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:38.268181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:38.268614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:38.269370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:38.269856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:38.270280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:38.293807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2a5457a1-0a1f-43e9-be18-c76995918cf5 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224/ips" status: 200 len: 149 microversion: 2.1 time: 0.036890 Oct 15 09:00:38.294570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 649/1290] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 09:00:38 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:38.656838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:38.657451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:38.664759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:38.665241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:38.665696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:38.666398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:38.666855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:38.667280 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:38.792893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:38.800968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-907f7201-bb42-4bf2-a939-4c2dad2bdec9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148059 Oct 15 09:00:38.801528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 642/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:39.824183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:39.824720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:39.831133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:39.832207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:39.832645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:39.833324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:39.833802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:39.834226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:39.961721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:39.969803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-729fab95-fc10-4be8-9bba-b11aea7d5ecb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149465 Oct 15 09:00:39.970387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 650/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:40.992596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:40.993206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:40.999702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:41.000173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:41.000597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:41.001274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:41.001739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:41.002161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:41.129599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:41.137798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-16da0eef-84ee-4c10-a71c-3e1438486eb7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149031 Oct 15 09:00:41.138369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 643/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:42.162234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:42.162851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:42.169181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:42.169662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:42.170170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:42.170855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:42.171308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:42.171735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:42.303821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:42.311888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2a5721c4-6c00-4eae-9544-65da1c1907ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153963 Oct 15 09:00:42.312450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 651/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:43.336871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:43.337472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:43.344009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:43.344483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:43.344911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:43.345589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:43.346059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:43.346476 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:43.472854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:43.481007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-987156ac-1dcc-48c4-bac5-7ba7e145563c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148228 Oct 15 09:00:43.481575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 644/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:43 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:44.504234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:44.504840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:44.511295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:44.511766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:44.512194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:44.512864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:44.513308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:44.513751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:44.639558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:44.648104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aca7dbdd-f79a-43d9-8649-804710358717 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147919 Oct 15 09:00:44.648654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 652/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:45.671751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:45.672282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:45.679265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:45.679750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:45.680188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:45.680871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:45.681322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:45.681773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:45.813277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:45.822059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2b4c0a8d-a994-40ec-baa7-5b25d33c2e57 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154229 Oct 15 09:00:45.822624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 645/1297] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:46.844903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:46.845543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:46.848466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=40 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:46.853896 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:46.854379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:46.854808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:46.855492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:46.855940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:46.856361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:46.995384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:47.004387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a17b79d8-1e52-4715-a2ac-9ad95613ed4d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.163233 Oct 15 09:00:47.005105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 653/1298] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:48.027495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:48.028151 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:48.030600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=46 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:48.036809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:48.037307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:48.037767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:48.038756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:48.039217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:48.039851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:48.171854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:48.179870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b1f357ea-8ec3-4e4d-a890-e6141996f400 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.156206 Oct 15 09:00:48.180430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 646/1299] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:48 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:49.202185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:49.202795 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:49.209187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:49.209661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:49.210122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:49.210796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:49.211243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:49.211658 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:49.336404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:49.344612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-76727ec7-3f09-4db8-aaf9-cba4e9baffb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146053 Oct 15 09:00:49.345173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 654/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:49 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:50.368502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:50.369045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:50.375677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:50.376147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:50.376573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:50.377249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:50.377720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:50.378141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:50.504299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:50.512447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e21bbb6c-ae50-4bd2-a07c-185e126ecd6b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148032 Oct 15 09:00:50.513014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 647/1301] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:51.536472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:51.537082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:51.543495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:51.543975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:51.544408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:51.545090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:51.545540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:51.545994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:51.673802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:51.682883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-62e36a06-df9f-442f-898c-d9352c42e33a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151066 Oct 15 09:00:51.683433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 655/1302] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:52.705469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:52.706114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:52.712574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:52.713057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:52.713517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:52.714237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:52.714693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:52.715114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:52.854656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:52.863677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3328446b-ccb6-4fad-8b0a-3be51aa24eda tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.161375 Oct 15 09:00:52.864251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 648/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:53.886236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:53.886849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:53.893132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:53.893611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:53.894076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:53.894760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:53.895210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:53.895632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:54.019371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:54.027553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-72c9446a-70f9-4ce0-a6fe-e2e0b55e33d3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145088 Oct 15 09:00:54.028109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 656/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:54.341991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:54.342502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:54.349629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:54.350135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:54.350563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:54.351254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:54.351701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:54.352122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:54.379137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:00:54.466576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e753fdd7-2b28-4611-9833-3c14cfc16af3 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 204 len: 0 microversion: 2.20 time: 0.128047 Oct 15 09:00:54.470185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 649/1305] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Oct 15 09:00:54 2022] DELETE /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 09:00:54.477628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:54.478555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:54.485355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:54.486129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:54.487603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:54.488611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:54.489088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:54.489776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:54.492277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:54.625133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:54.633855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:54.635309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:54.636464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-59a1befc-1ba6-437a-9d16-a53f5b07c01c tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1723 microversion: 2.20 time: 0.164697 Oct 15 09:00:54.637011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 657/1306] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 09:00:54 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 09:00:55.053213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:55.054076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:55.060020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:55.060586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:55.061093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:55.061894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:55.062420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:55.062927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:55.290051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:55.292314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:00:55.299998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ba34c3bd-c1fc-48ae-8151-17a751520ce5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.251932 Oct 15 09:00:55.301163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 650/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:55 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:00:55.662424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:55.662961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:55.669500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:55.670011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:55.670444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:55.671136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:55.671783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:55.672207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:55.751757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:55.760599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:55.762066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '388ca829d87348bd9b524fd9a80e578b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e3a95b1487450cad043a820d321f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:55.763226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dbd995bf-3fa7-424a-a95c-fe08654fee72 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 200 len: 1655 microversion: 2.20 time: 0.105188 Oct 15 09:00:55.763775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 658/1308] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 09:00:55 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 1655 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 15 09:00:55.813954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29f95b72-8aed-4cf1-9d99-e9a96e09e797", "name": "network-vif-deleted", "tag": "694e5f8f-4497-4c10-84f4-ad5add1f1bb2"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:00:55.828904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:55.830005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:55.830691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:55.850067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] Creating event network-vif-deleted:694e5f8f-4497-4c10-84f4-ad5add1f1bb2 for instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 on hv-cinder-85697 Oct 15 09:00:55.855727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-4b93c0e4-14cd-40c1-8fe7-d7cba828a732 req-20cccbb3-994d-4148-9d1d-6e0056ecb581 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045442 Oct 15 09:00:55.857359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 651/1309] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:00:56.323765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:56.324500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:56.330499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:56.330982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:56.331951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:56.332623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:56.333079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:56.333502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:56.478571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:56.489018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-90240614-84ae-4741-aa3f-8f7274624a47 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.168907 Oct 15 09:00:56.494508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 659/1310] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:56.789230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:56.789969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:56.796093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:56.796648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:56.797176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:56.798195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:56.798805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:56.799729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:56.814605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 HTTP/1.1 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:00:56.816767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:00:56.818684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '29f95b72-8aed-4cf1-9d99-e9a96e09e797'} Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:00:56.819665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:00:56.821392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:00:56.823176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:00:56.823176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2c07a968-e708-41f6-805f-d54e42cf29a2 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 404 len: 111 microversion: 2.20 time: 0.033218 Oct 15 09:00:56.823176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 652/1311] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 09:00:56 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 09:00:56.827196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d14dd277-3249-4334-b33b-5882b44ad7ea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '.version_select at 0x7f575e6381f0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:56.846985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d14dd277-3249-4334-b33b-5882b44ad7ea tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324521777" status: 204 len: 0 microversion: 2.20 time: 0.023549 Oct 15 09:00:56.847561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 660/1312] 10.222.0.30 () {60 vars in 1259 bytes} [Sat Oct 15 09:00:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324521777 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 15 09:00:57.511937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:57.512549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:57.524253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:57.524747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:57.525212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:57.525977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:57.526437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:57.526870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:57.658049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:57.667127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86ce0dc6-bfe1-4557-be3c-2f623d337a9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.159176 Oct 15 09:00:57.667691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 653/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:58.692553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:58.693169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:58.700095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:58.700578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:58.701013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:58.701721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:58.702174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:58.702596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:58.830593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:00:58.838745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bd63b4f9-0d3b-440a-98e0-30ea2df93bdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151170 Oct 15 09:00:58.839300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 661/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:00:59.861707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:00:59.862328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:00:59.868703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:59.869177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:59.869607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:59.870308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:00:59.870757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:00:59.871175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:00:59.997426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:00.005984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86adb2ec-b2e3-4a36-92aa-66b842995e6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148068 Oct 15 09:01:00.006551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 654/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:00:59 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:01.029076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:01.029714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:01.036396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:01.036874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:01.037304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:01.038019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:01.038470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:01.038893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:01.162528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:01.170587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1890dcc9-f824-49cd-937b-db44dc25192b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145332 Oct 15 09:01:01.171144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 662/1316] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:01 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:02.291795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:02.292401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:02.298777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:02.299287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:02.299718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:02.300488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:02.300934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:02.301352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:02.430052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:02.438499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c1e8890a-563a-43e4-9aee-555685cd744b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.249178 Oct 15 09:01:02.439063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 655/1317] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:02 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:03.462571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:03.463209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:03.469643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:03.470157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:03.470591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:03.471277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:03.471735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:03.472776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:03.598388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:03.606549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-603b44a7-7754-4964-b3f2-8190f119b66d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147890 Oct 15 09:01:03.607106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 663/1318] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:04.629864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:04.630430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:04.636942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:04.637415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:04.637875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:04.638554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:04.639001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:04.639455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:04.767982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:04.776638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f8917884-c01b-490c-9a45-225fc78cc713 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150747 Oct 15 09:01:04.777212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 656/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:05.799662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:05.800955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:05.807553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:05.808033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:05.808465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:05.809155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:05.809607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:05.810058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:05.934213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:05.942456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c1064fe2-99b6-46e6-bfa9-927785e6a959 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146606 Oct 15 09:01:05.943074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 664/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:06.965006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:06.965584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:06.972140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:06.972620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:06.973053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:06.973752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:06.974201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:06.974616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:07.104264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:07.112911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0d76dd56-8ca2-4a90-a8ff-b22e1c15c6e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151299 Oct 15 09:01:07.113478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 657/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:08.135248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:08.135854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:08.141974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:08.142448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:08.142875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:08.143610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:08.144059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:08.144475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:08.269868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:08.278066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aef21f38-0c71-4734-bb0a-f89c908f2cfa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146523 Oct 15 09:01:08.278565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 665/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:08 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:09.300897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:09.301512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:09.308062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:09.308538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:09.308971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:09.309654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:09.310135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:09.310556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:09.437176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:09.445976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3120908b-c1c1-4d9d-88d5-6866f29556a7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149358 Oct 15 09:01:09.446537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 658/1323] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:10.468680 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:10.469274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:10.476880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:10.477357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:10.477821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:10.478513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:10.478966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:10.479389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:10.608268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:10.616907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d410fc76-aa56-4013-8f4b-2bd15e8c5c31 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152594 Oct 15 09:01:10.617470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 666/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:11.640298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:11.640848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:11.647834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:11.648311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:11.648780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:11.649474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:11.649956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:11.650386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:11.775945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:11.784556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-831e4cb7-337c-43f8-a963-f00764b6dd12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147847 Oct 15 09:01:11.785126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 659/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:12.807337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:12.807849 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:12.814186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:12.814659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:12.815079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:12.815779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:12.816686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:12.816686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:12.953123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:12.961894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-acf3dfe8-fae3-4f05-a8de-eb5e19003b12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.158414 Oct 15 09:01:12.962443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 667/1326] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:13.985036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:13.985649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:13.992629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:13.993110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:13.993541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:13.994253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:13.994710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:13.995131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:14.123346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:14.131560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-330edd5f-801c-4f91-a7a4-5f370d8be512 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150268 Oct 15 09:01:14.132095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 660/1327] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:15.154162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:15.154815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:15.161800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:15.162278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:15.162706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:15.163385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:15.163830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:15.164250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:15.291254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:15.299850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-be783fd0-f197-4281-bd5d-ac958a791b46 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149551 Oct 15 09:01:15.300407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 668/1328] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:16.322581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:16.323197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:16.329698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:16.330188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:16.330622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:16.331299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:16.331755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:16.332174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:16.463637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:16.472680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c833f07f-7e7d-4e6d-aac1-96dfef8ee576 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153888 Oct 15 09:01:16.473282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 661/1329] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:17.496100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:17.496844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:17.499111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:17.505147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:17.505631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:17.506086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:17.506775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:17.507221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:17.507639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:17.635224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:17.643406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b9f4fb26-724b-4a78-9cea-0553f4e62749 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151159 Oct 15 09:01:17.643958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 669/1330] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:18.666054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:18.666606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:18.669014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:18.674160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:18.674710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:18.675137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:18.675816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:18.676263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:18.676682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:18.806678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:18.814816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c8a1530e-8a30-4a0d-862a-0108dde47844 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152685 Oct 15 09:01:18.815906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 662/1331] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:19.838009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:19.838625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:19.845031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:19.845513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:19.845992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:19.847264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:19.847721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:19.848146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:19.972989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:19.981103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-034992a6-169e-4471-a488-bd7216497299 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146929 Oct 15 09:01:19.981668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 670/1332] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:21.004503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:21.005119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:21.011535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:21.012025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:21.012462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:21.013152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:21.013607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:21.014058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:21.142160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:21.150367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-37fe9ff3-057e-42c4-8436-87cbaf536baf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150210 Oct 15 09:01:21.150946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 663/1333] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:22.173444 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:22.174083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:22.180831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:22.181309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:22.181775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:22.182464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:22.182914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:22.183337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:22.306911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:22.315497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-40de3fed-92bd-4621-8fb1-fd52a53b106e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145348 Oct 15 09:01:22.316057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 671/1334] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:22 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:23.338288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:23.338908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:23.345374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:23.345899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:23.346935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:23.347625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:23.348080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:23.348503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:23.478653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:23.486883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b537014b-3d4b-4f67-9bf5-1ee38c94078c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152464 Oct 15 09:01:23.487447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 664/1335] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:23 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:24.509696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:24.510306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:24.516625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:24.517106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:24.517564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:24.518303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:24.518677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:24.519168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:24.523109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=84 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:24.649578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:24.657724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e94b8be8-19d7-48d9-bfeb-6d2cc1892a5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152011 Oct 15 09:01:24.658241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 672/1336] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:25.681172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:25.681816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:25.688300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:25.688782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:25.689216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:25.689927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:25.690379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:25.690800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:25.814540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:25.822565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-77cd55d3-109b-4ec6-bb37-241697f849e3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145236 Oct 15 09:01:25.823140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 665/1337] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:26.845737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:26.846808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:26.853297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:26.853816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:26.854251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:26.854933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:26.855383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:26.855801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:26.982584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:26.991215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2afe509e-e519-4d29-8353-f98b089b42f5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149374 Oct 15 09:01:26.991762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 673/1338] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:28.014174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:28.014784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:28.022013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:28.022413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:28.022840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:28.023526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:28.023976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:28.024394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:28.028326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=84 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:28.151502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:28.160741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-95fc79b9-9762-428b-ac26-b7be35daf528 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150457 Oct 15 09:01:28.161305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 666/1339] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:28 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:29.183372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:29.183973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:29.190783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:29.191257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:29.191686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:29.192362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:29.192811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:29.193228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:29.318911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:29.326985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c2a2ba8c-88f1-4823-a184-3b0ab16a5a4c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147391 Oct 15 09:01:29.327479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 674/1340] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:29 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:30.350195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:30.350809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:30.357220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:30.357721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:30.358156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:30.358836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:30.359286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:30.359705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:30.489866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:30.497989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ceba322c-51fa-477a-b422-de00f70aa8b8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151650 Oct 15 09:01:30.498549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 667/1341] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:30 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:31.520754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:31.521366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:31.527747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:31.528226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:31.528657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:31.529337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:31.529808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:31.530232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:31.653381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:31.661816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-87652aee-5e0a-453a-adab-8a9fad743c6e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145592 Oct 15 09:01:31.662371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 675/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:32.684199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:32.684831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:32.692035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:32.692507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:32.692943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:32.693621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:32.694100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:32.694516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:32.824792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:32.833634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e1a98b3-5104-4a8e-9ca4-5c99c99d8bc1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153241 Oct 15 09:01:32.834231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 668/1343] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:33.856700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:33.857241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:33.863577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:33.864051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:33.864477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:33.865155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:33.865605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:33.866051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:33.993348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:34.002080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8b1bef6c-e1fd-4afc-9f16-99d06e74af9c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149187 Oct 15 09:01:34.002713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 676/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:35.028114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:35.028731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:35.035875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:35.036357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:35.036789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:35.037475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:35.037955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:35.038379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:35.167340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:35.176044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dec2dbac-5325-4588-b537-8050ae98f83d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151728 Oct 15 09:01:35.176615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 669/1345] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:36.198759 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:36.199361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:36.206172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:36.206626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:36.207052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:36.207725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:36.208169 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:36.208585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:36.332814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:36.341010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3689f63f-eb7d-4d6e-8b36-53ff9feb61ac tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146224 Oct 15 09:01:36.341566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 677/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:36 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:37.365404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:37.366058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:37.372160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:37.372643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:37.373082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:37.373794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:37.374253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:37.374678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:37.500766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:37.509577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2844fbf2-5a33-425d-a970-5f5af6eda41e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148878 Oct 15 09:01:37.510172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 670/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:37 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:38.533643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:38.534533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:38.540922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:38.541399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:38.541892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:38.542574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:38.543027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:38.543464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:38.673230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:38.681325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ed33c1b8-fb92-4a6e-9a7f-c2ab7d939895 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152141 Oct 15 09:01:38.681990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 678/1348] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:39.704034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:39.704650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:39.711184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:39.711665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:39.712096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:39.712791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:39.713249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:39.713704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:39.837196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:39.845333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f22dba06-0c34-4f68-96c2-ced689c89dd2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145098 Oct 15 09:01:39.845928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 671/1349] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:40.868145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:40.868756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:40.875208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:40.875684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:40.876114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:40.877416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:40.877899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:40.878322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:41.006716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:41.014892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9f492620-dc96-465f-810a-a46d007963ef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150685 Oct 15 09:01:41.015451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 679/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:42.038749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:42.039371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:42.045702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:42.046199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:42.046632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:42.047861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:42.048320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:42.048790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:42.174883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:42.182986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-34771717-ffff-4126-84ad-cec1a7a76ec4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148104 Oct 15 09:01:42.183549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 672/1351] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:43.207066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:43.207683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:43.214117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:43.214602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:43.215037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:43.215723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:43.216176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:43.216607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:43.341398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:43.349524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f7af19e1-2b23-42ad-ab6b-e172a5090922 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146836 Oct 15 09:01:43.350119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 680/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:43 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:44.371605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:44.372159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:44.379328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:44.379894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:44.380361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:44.381051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:44.381503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:44.381973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:44.510153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:44.518772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ccfa8cb5-a2ad-4027-9e06-ce1bed94f92f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151134 Oct 15 09:01:44.519343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 673/1353] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:45.542946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:45.543567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:45.550999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:45.551478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:45.552100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:45.552796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:45.553250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:45.553696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:45.690953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:45.699048 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-62df5ac7-b3b1-45e8-8b3c-a7a277c30a24 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.160041 Oct 15 09:01:45.699608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 681/1354] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:46.721756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:46.722372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:46.728661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:46.729144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:46.729572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:46.730297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:46.730746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:46.731170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:47.109398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:47.118546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3b1070fa-5aff-44bb-9253-924729ce43b4 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.400393 Oct 15 09:01:47.119195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 674/1355] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:48.140495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:48.141126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:48.143990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:48.149201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:48.149694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:48.150121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:48.150798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:48.151338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:48.151647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:48.276004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:48.284595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-186310b9-3004-49e0-a4ef-702bfd6344ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147617 Oct 15 09:01:48.285156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 682/1356] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:48 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:49.307224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:49.308279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:49.310282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:49.315557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:49.316147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:49.316599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:49.317297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:49.317780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:49.318211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:49.446375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:49.454504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dc458e11-0afa-4f89-90aa-4a15032811a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151176 Oct 15 09:01:49.455080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 675/1357] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:49 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:50.477193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:50.477874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:50.484191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:50.484669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:50.485102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:50.485818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:50.486313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:50.486743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:50.611300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:50.619458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c33e96e4-5b87-404d-a269-dd73ce2d9f56 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146086 Oct 15 09:01:50.620012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 683/1358] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:51.642765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:51.643378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:51.650146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:51.650624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:51.651056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:51.651740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:51.652193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:51.652616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:51.781361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:51.789883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c2e201c2-b03a-4577-8130-5082f7a7e6ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151576 Oct 15 09:01:51.790458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 676/1359] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:52.812787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:52.813405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:52.820448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:52.820923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:52.821351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:52.822055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:52.822507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:52.822923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:52.946668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:52.954894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a5a99565-5544-43be-bebd-88ff08575341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145948 Oct 15 09:01:52.955454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 684/1360] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:01:53.976802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:53.977442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:53.983828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:53.984304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:53.984730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:53.985410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:53.985885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:53.986323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:54.212502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:54.221030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-111bd51c-df5f-4729-8ea9-aa521ea9dd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.248065 Oct 15 09:01:54.221608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 677/1361] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:55.244201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:55.244812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:55.251194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:55.251704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:55.252140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:55.252827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:55.253284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:55.253731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:55.256229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:55.381598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:55.392162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-05ea345a-667f-4486-9bcb-f97243eb2a12 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150383 Oct 15 09:01:55.392855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 685/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:55 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:56.415865 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:56.416511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:56.423088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:56.424020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:56.424446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:56.425122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:56.425574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:56.426017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:56.558331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:56.567205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a7c18fc4-0bf3-4485-84e1-fbdfe0d968d1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.155153 Oct 15 09:01:56.567777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 678/1363] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:57.589808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:57.590449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:57.597383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:57.597915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:57.598350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:57.599042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:57.599493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:57.599913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:57.723901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:57.732043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-940d0869-6bdb-4fdc-b63c-5e325440c85f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146070 Oct 15 09:01:57.732600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 686/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:58.755946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:58.756563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:58.762976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:58.763452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:58.763886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:58.764569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:58.765021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:58.765442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:58.769300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:01:58.891651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:01:58.899838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5a8494bd-5eef-4c1e-8c72-8e906093fdb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148330 Oct 15 09:01:58.900404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 679/1365] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:01:59.922771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:01:59.923401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:01:59.929790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:59.930271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:59.930699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:01:59.931403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:01:59.931847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:01:59.932265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:00.062795 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:00.071064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3cf793bc-b654-44c7-b65a-06480a606f14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Oct 15 09:02:00.071632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 687/1366] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:01:59 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:01.094370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:01.094977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:01.101957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:01.102434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:01.102886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:01.103566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:01.104011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:01.104426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:01.228598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:01.236922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-601a18d0-deea-4f99-a67e-8ae39b24b797 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146432 Oct 15 09:02:01.237490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 680/1367] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:01 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:02.260154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:02.260761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:02.267233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:02.267703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:02.268132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:02.268806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:02.269250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:02.269667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:02.397850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:02.406184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8b0e26b7-1a1e-49e0-9460-513c61259025 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149837 Oct 15 09:02:02.406747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 688/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:02 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:03.431332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:03.431947 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:03.438506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:03.439486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:03.439912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:03.440586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:03.441029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:03.441443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:03.565232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:03.573314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-709d3f2e-20ed-46b6-9bde-69dd1cd9669a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145995 Oct 15 09:02:03.573904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 681/1369] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:04.597271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:04.597880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:04.604323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:04.604801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:04.605227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:04.605934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:04.606382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:04.606799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:04.737423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:04.745661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bf3592f6-ec92-4869-aa1c-fdc88f81d7cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152914 Oct 15 09:02:04.746280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 689/1370] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:05.768099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:05.768711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:05.775054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:05.775529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:05.775956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:05.776632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:05.777079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:05.777495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:05.904265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:05.913183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca553e76-51f9-4620-a36c-d849ba5d069a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148848 Oct 15 09:02:05.913763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 682/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:06.936590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:06.937200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:06.944019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:06.944495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:06.944928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:06.945605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:06.946083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:06.946506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:07.076507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:07.084772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0e0b011b-6732-44d8-8a5e-daf3bb1a604a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152055 Oct 15 09:02:07.085328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 690/1372] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:08.107298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:08.107909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:08.114584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:08.115054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:08.115482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:08.116157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:08.116599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:08.117011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:08.245391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:08.253638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a79efffe-0259-45a2-a04f-4662a81ecac3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150110 Oct 15 09:02:08.254226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 683/1373] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:08 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:09.276428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:09.277040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:09.283492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:09.283967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:09.284667 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:09.285347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:09.285838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:09.286266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:09.413178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:09.421563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-adb3fbfe-dc99-4f67-9911-c8f8d074eacc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148974 Oct 15 09:02:09.422147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 691/1374] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:10.445319 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:10.445906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:10.452256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:10.452734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:10.453167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:10.453886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:10.455003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:10.455425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:10.583119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:10.591248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4eeb6b26-b2be-4612-bbd0-ee93ee65ab63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149866 Oct 15 09:02:10.591807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 684/1375] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:11.614565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:11.615153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:11.621538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:11.622043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:11.622471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:11.623148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:11.623594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:11.624008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:11.751601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:11.759630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4d47e01e-edaf-402a-873a-07ab0e6f4779 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149439 Oct 15 09:02:11.760189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 692/1376] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:12.782815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:12.783607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:12.791805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:12.792293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:12.792732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:12.793431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:12.793993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:12.794423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:12.919442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:12.928147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8002e12-1bc7-438d-b7a9-39ea8818cd79 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149605 Oct 15 09:02:12.928719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 685/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:13.952047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:13.952688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:13.959236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:13.959710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:13.960144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:13.960826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:13.961275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:13.961713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:14.090863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:14.099433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a59cb7f7-d4c7-4955-9a46-91fd9ca6b375 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151210 Oct 15 09:02:14.099989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 693/1378] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:15.122196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:15.122839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:15.130247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:15.130735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:15.131618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:15.131841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:15.132294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:15.132718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:15.270312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:15.278780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ceb999f6-2247-4760-87e6-a496bc6816ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.160403 Oct 15 09:02:15.279343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 686/1379] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:16.303245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:16.304003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:16.310556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:16.311035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:16.311465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:16.312179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:16.312628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:16.313245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:16.447355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:16.456533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eb298eae-d19f-492f-b8c1-1b60e0bd8c06 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.158164 Oct 15 09:02:16.457113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 694/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:17.479437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:17.480052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:17.486803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:17.487290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:17.487725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:17.488509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:17.488955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:17.489273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:17.620595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:17.628880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-38e74948-048f-4892-9bc7-d731562c0e14 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153294 Oct 15 09:02:17.629448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 687/1381] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:18.651898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:18.652509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:18.654839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:18.660754 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:18.661227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:18.661659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:18.662362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:18.662813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:18.663234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:18.791414 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:18.800461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bf5a3efb-afe9-439f-a1e9-9ec2be0b5f3c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152358 Oct 15 09:02:18.801086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 695/1382] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:19.822446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:19.823065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:19.825412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:19.830759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:19.831241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:19.831677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:19.832368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:19.832824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:19.833251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:19.959528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:19.967650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5c2087c5-d617-4fc4-b52e-c090e0ec7786 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149047 Oct 15 09:02:19.968210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 688/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:20.991537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:20.992143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:20.998536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:20.999013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:20.999445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:21.000128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:21.000579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:21.001000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:21.126400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:21.134533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-197808b0-72bc-42b7-9340-ce591541f679 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146808 Oct 15 09:02:21.135097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 696/1384] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:22.157097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:22.157731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:22.164917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:22.165392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:22.165855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:22.166532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:22.166975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:22.167394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:22.296825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:22.305266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d606fefa-5153-45a0-a47c-8602d5907074 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151988 Oct 15 09:02:22.305847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 689/1385] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:22 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:23.328379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:23.328922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:23.335916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:23.336395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:23.336828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:23.337512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:23.338003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:23.338424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:23.462986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:23.471744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84ba2fe3-4880-405e-a18b-f82c69dc83bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146672 Oct 15 09:02:23.472306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 697/1386] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:23 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:24.495421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:24.496039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:24.502506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:24.502985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:24.503419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:24.504102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:24.504557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:24.504981 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:24.633059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:24.641249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-48342e16-abc6-4a1d-b6ae-a52444147f1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149753 Oct 15 09:02:24.641840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 690/1387] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:25.665051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:25.665571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:25.672030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:25.672513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:25.672943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:25.673733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:25.674192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:25.674616 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:25.677087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:25.805971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:25.814193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e6b384da-eff3-4032-b60e-3868280eb086 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153044 Oct 15 09:02:25.815382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 698/1388] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:26.837371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:26.838004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:26.844442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:26.844912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:26.845336 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:26.846550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:26.846996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:26.847412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:26.975882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:26.985015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-715bf0da-118f-4ed7-88bc-bb3740fe5f97 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151424 Oct 15 09:02:26.985778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 691/1389] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:28.008229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:28.008847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:28.015276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:28.015756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:28.016187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:28.016875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:28.017324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:28.018302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:28.149111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:28.157280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7cc7e14f-4e26-4e4b-8324-15f6d4c686ff tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152838 Oct 15 09:02:28.157865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 699/1390] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:28 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:29.180789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:29.181407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:29.187819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:29.188303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:29.188738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:29.189428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:29.189918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:29.190342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:29.194227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:29.316271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:29.324435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe20e7e5-8fdf-4cd3-b37a-d4477aae59dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147409 Oct 15 09:02:29.325006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 692/1391] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:29 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:30.348486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:30.349095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:30.355609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:30.356086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:30.356520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:30.357203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:30.357650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:30.358107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:30.488252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:30.496588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b59f7310-f228-473e-954e-f17f046e462d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152640 Oct 15 09:02:30.497142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 700/1392] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:30 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:02:31.520656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:31.521370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:31.527804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:31.528286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:31.528727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:31.529416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:31.529926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:31.530351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:31.654550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:31.663262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cf6a4b93-bbef-4efa-bfe3-71dc263b06ed tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146958 Oct 15 09:02:31.663827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 693/1393] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:32.685009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:32.685562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:32.691900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:32.692373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:32.692800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:32.693475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:32.693946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:32.694361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:32.822221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:32.830361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f4872be4-0f44-400f-a30a-23dbd09d2378 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149275 Oct 15 09:02:32.831679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 701/1394] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:33.853077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:33.853619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:33.860061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:33.860539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:33.860971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:33.861653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:33.862644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:33.863069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:33.987732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:33.995908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-45f24117-c38f-4a92-a566-b524675b9e38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146818 Oct 15 09:02:33.996475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 694/1395] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:35.020399 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:35.021006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:35.027365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:35.027841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:35.028280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:35.028961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:35.029409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:35.029878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:35.155060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:35.164115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-75fe4a84-10c0-49c0-af6e-2b087adff592 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148189 Oct 15 09:02:35.164678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 702/1396] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:36.186380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:36.186987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:36.193407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:36.193918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:36.194347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:36.195026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:36.195477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:36.195893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:36.325147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:36.333845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d5ef50b7-6b11-499d-82fb-166815e9deef tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151233 Oct 15 09:02:36.334411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 695/1397] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:36 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:37.357069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:37.357697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:37.364411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:37.364895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:37.365330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:37.366057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:37.366520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:37.366944 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:37.496316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:37.504741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c50ee4a8-268e-4591-97f3-fe8aa3e69428 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151468 Oct 15 09:02:37.505310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 703/1398] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:37 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:38.528076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:38.528839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:38.535195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:38.535951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:38.536422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:38.537147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:38.537631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:38.538087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:38.669277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:38.677508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-51bfe10b-2453-4614-a0c9-d609b0eb1453 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153378 Oct 15 09:02:38.678106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 696/1399] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:39.700249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:39.700853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:39.707278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:39.707747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:39.708173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:39.708848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:39.709293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:39.709737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:39.834067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:39.842173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-13e9ffda-a6cd-40c5-9907-f9943f464a96 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145716 Oct 15 09:02:39.842669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 704/1400] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:40.866452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:40.867075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:40.873431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:40.873943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:40.874408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:40.875093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:40.875544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:40.875965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:41.000951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:41.009051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-335f3f7b-f9ff-48b1-b1ce-8d7d785d32fa tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147067 Oct 15 09:02:41.009626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 697/1401] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:42.031705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:42.032325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:42.039594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:42.040076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:42.040514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:42.041201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:42.041656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:42.042106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:42.174134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:42.182271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-820926f0-0872-4b88-b658-1839c09f01ee tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154385 Oct 15 09:02:42.182829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 705/1402] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:43.204816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:43.205425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:43.212349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:43.212824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:43.213252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:43.213950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:43.214399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:43.214816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:43.339083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:43.347196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d4747a49-daa5-4b08-b26a-65588ddae418 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146216 Oct 15 09:02:43.347765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 698/1403] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:43 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:44.371018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:44.371618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:44.377904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:44.378378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:44.378803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:44.379480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:44.379924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:44.380342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:44.511403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:44.520139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-038ac245-fc57-449d-b01c-7669970580c2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153021 Oct 15 09:02:44.520734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 706/1404] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:45.544011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:45.544653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:45.551073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:45.551546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:45.551975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:45.552653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:45.553101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:45.553520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:45.678682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:45.686799 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6fb165d4-e562-429d-bfc2-58822d958540 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146629 Oct 15 09:02:45.687373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 699/1405] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:46.710464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:46.711118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:46.717548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:46.718063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:46.718499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:46.719183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:46.719640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:46.720066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:46.847720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:46.855963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3bd396aa-9d6a-472f-bb9f-0b724c6d0523 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149318 Oct 15 09:02:46.856549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 707/1406] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:47.879388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:47.880031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:47.886483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:47.886961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:47.887395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:47.888078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:47.888528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:47.888958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:48.015001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:48.024149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-01f16b86-9f97-448c-a311-58376f3cfbab tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149099 Oct 15 09:02:48.024846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 700/1407] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:47 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:49.047424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:49.048043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:49.050929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:49.057120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:49.057785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:49.058227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:49.059240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:49.059703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:49.060129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:49.200925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:49.210024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ebc69f06-ef31-4573-b957-76a737332257 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.166505 Oct 15 09:02:49.210602 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 708/1408] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:49 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:50.233636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:50.234278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:50.238484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:50.242385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:50.242875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:50.243312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:50.244006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:50.244459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:50.244883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:50.376670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:50.385036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ade98ee1-95f0-4a8d-a3f3-59be823f7d8e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.155326 Oct 15 09:02:50.385614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 701/1409] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:51.407413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:51.408024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:51.414983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:51.415401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:51.415829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:51.416508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:51.416953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:51.417373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:51.543307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:51.551410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9660b816-f5cf-49b5-9fd6-d2660716812f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147853 Oct 15 09:02:51.551999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 709/1410] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:52.574636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:52.575246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:52.581623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:52.582139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:52.582565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:52.583241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:52.583685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:52.584100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:52.712314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:52.720494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c642d642-62e3-4fce-92c2-7a35a03b381f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149681 Oct 15 09:02:52.721068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 702/1411] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:02:53.743736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:53.744337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:53.750665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:53.751144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:53.751603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:53.752292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:53.752747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:53.753171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:53.877158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:53.885239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a7a48288-fd36-41d0-ae13-ecf52beec48d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145446 Oct 15 09:02:53.885814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 710/1412] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:54.908383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:54.908953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:54.915856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:54.916365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:54.916793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:54.917484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:54.917955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:54.918381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:55.052671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:55.062435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-de02a7fa-c22c-4b08-a616-5f78a186aaf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.157897 Oct 15 09:02:55.063443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 703/1413] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:54 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:56.086391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:56.087002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:56.093379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:56.093890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:56.094321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:56.094996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:56.095441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:56.096357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:56.100163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:56.224078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:56.232221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cc53f5ca-8988-4947-b3ca-345c906da174 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149662 Oct 15 09:02:56.232779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 711/1414] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:57.256108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:57.256730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:57.263225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:57.263698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:57.264131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:57.264810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:57.265260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:57.265696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:57.393852 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:57.402154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c47f9e29-cb56-4444-aa19-a6db70a9df0d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150346 Oct 15 09:02:57.402717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 704/1415] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:58.425908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:58.426511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:58.433004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:58.433519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:58.433996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:58.434684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:58.435130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:58.435575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:58.568106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:58.576216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-72f066bb-aef6-470b-9191-ff4220a39599 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154231 Oct 15 09:02:58.576773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 712/1416] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:02:59.600425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:02:59.601033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:02:59.607414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:59.607887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:59.608315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:59.608991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:02:59.609437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:02:59.609910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:02:59.612401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:02:59.745131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:02:59.755420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-044f3940-b2e8-4437-94d7-9434fba20a1c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.159478 Oct 15 09:02:59.755986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 705/1417] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:02:59 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:00.778112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:00.778804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:00.786116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:00.786662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:00.787099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:00.787787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:00.788240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:00.788661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:00.927284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:00.935568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-34f1b3a6-f04d-4e7e-8247-86d2e585d6be tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.161319 Oct 15 09:03:00.936098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 713/1418] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:00 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:01.958086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:01.958600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:01.965029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:01.965499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:01.965956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:01.966641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:01.967088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:01.967505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:02.092580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:02.100653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5d674295-0ac5-4897-9ab5-2a2849edf341 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147227 Oct 15 09:03:02.101215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 706/1419] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:01 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:03.123150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:03.123723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:03.131308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:03.131781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:03.132212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:03.132895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:03.133347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:03.133853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:03.258360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:03.266433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5e973aaf-94c1-4cef-992c-31629c4193d6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147203 Oct 15 09:03:03.266987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 714/1420] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:04.289760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:04.290433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:04.296805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:04.297282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:04.297734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:04.298421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:04.299501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:04.299924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:04.429132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:04.437961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-98908ba9-22ed-47a0-aa54-480920146e2a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151987 Oct 15 09:03:04.438539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 707/1421] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:05.461225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:05.461869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:05.468242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:05.468715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:05.469144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:05.469865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:05.470309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:05.471349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:05.596546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:05.604735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e998cf46-f78f-4ee1-bba8-78f0b2cf67a9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147306 Oct 15 09:03:05.605273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 715/1422] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:06.627130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:06.627896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:06.634290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:06.634765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:06.635191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:06.635867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:06.636311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:06.636728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:06.769010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:06.777128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4bcccb7e-33fe-4360-a836-fda54b2d3284 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153922 Oct 15 09:03:06.777848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 708/1423] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:07.800288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:07.800895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:07.807236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:07.807708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:07.808135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:07.808807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:07.809369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:07.809820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:07.934189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:07.942707 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5620a5a7-2baf-4635-a19b-46ec365512f6 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146285 Oct 15 09:03:07.943266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 716/1424] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:07 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:08.966184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:08.966796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:08.972879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:08.973360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:08.973850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:08.974538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:08.974989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:08.975411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:09.097621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:09.105751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bda0a2bd-70d0-493c-ac39-9423400b9fe7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.143368 Oct 15 09:03:09.106320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 709/1425] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:08 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:10.129554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:10.130196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:10.132559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:03:10.132704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:03:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 (ip 10.222.0.30) !!! Oct 15 09:03:10.138192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:10.138663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:10.139089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:10.139765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:10.140207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:10.140623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:10.273062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:10.281613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4ffc50be-b8b1-4a17-a2a7-26db34e9bdfd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.156421 Oct 15 09:03:10.288147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 717/1426] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:11.305333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:11.306445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:11.312367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:11.312908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:11.313350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:11.314637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:11.315094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:11.315521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:11.446908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:11.455331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fb3d1018-bd32-4891-b7e9-b904eaf038c3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153839 Oct 15 09:03:11.455905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 710/1427] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:12.479383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:12.480543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:12.487872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:12.488355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:12.488786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:12.489480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:12.489966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:12.490393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:12.618349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:12.626463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0df09f22-ad70-4c17-a6de-579014c68566 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151763 Oct 15 09:03:12.627021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 718/1428] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:13.649373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:13.649954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:13.656905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:13.657379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:13.658493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:13.659172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:13.659882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:13.660302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:13.784857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:13.792885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1a3d8571-4e09-4250-9d18-26013f6428e9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147399 Oct 15 09:03:13.793445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 711/1429] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:14.815969 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:14.816579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:14.823246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:14.823727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:14.824162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:14.824846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:14.825298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:14.825741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:14.954052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:14.962839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-18b4c28d-8998-435b-af79-98de40aa8395 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151199 Oct 15 09:03:14.963400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 719/1430] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:14 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:15.985616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:15.986216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:15.992638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:15.993115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:15.993547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:15.994263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:15.994718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:15.995145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:16.120446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:16.129199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-548038b8-ee5d-4350-b88b-10d56b269217 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147491 Oct 15 09:03:16.129778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 712/1431] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:15 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:17.152408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:17.153059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:17.160197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:17.160677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:17.161113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:17.161827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:17.162284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:17.162710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:17.286659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:17.294776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ab01f714-8714-40d3-a941-96da532f5121 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146253 Oct 15 09:03:17.295330 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 720/1432] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:18.318247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:18.318850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:18.325221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:18.325721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:18.326152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:18.326832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:18.327288 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:18.327703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:18.455745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:18.463913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3a3ff705-d4c8-4c91-abb0-5d0d10bf57bf tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150201 Oct 15 09:03:18.464483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 713/1433] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:19.487964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:19.488572 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:19.490891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:19.496070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:19.496546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:19.496978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:19.497654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:19.498124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:19.498538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:19.623575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:19.631669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-21dc87d2-a2c1-447c-aef8-9366846907e5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148168 Oct 15 09:03:19.632229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 721/1434] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:20.656338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:20.656904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:20.659993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:20.665194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:20.665669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:20.666193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:20.666867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:20.667316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:20.667736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:20.794627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:20.803562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fdaa149c-47e7-4af9-95d1-e29221569977 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151083 Oct 15 09:03:20.804325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 714/1435] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:21.826462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:21.827068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:21.833526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:21.833908 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:21.834336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:21.835022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:21.835502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:21.835875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:21.967335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:21.975776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0731df6f-9962-4224-a547-8b66075825dc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153153 Oct 15 09:03:21.976347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 722/1436] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:21 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:22.999149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:22.999847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:23.006768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:23.007286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:23.007666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:23.008352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:23.008802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:23.009222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:23.141432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:23.149696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ea7768f5-0332-412f-b3bd-e3b0094e2a81 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154403 Oct 15 09:03:23.150259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 715/1437] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:22 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:24.172121 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:24.172728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:24.179131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:24.179610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:24.180042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:24.180720 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:24.181171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:24.181591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:24.307962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:24.315958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0d8187ae-9390-4517-9454-4e4ff22e4f0f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147614 Oct 15 09:03:24.316523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 723/1438] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:25.339260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:25.339880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:25.346888 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:25.347370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:25.347808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:25.348497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:25.348954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:25.349384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:25.474556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:25.482646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a1093e83-529d-444a-ae2e-7e519a91994f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147306 Oct 15 09:03:25.483219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 716/1439] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:26.506579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:26.507190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:26.513578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:26.514115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:26.514549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:26.515230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:26.515682 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:26.516103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:26.518663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:26.643885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:26.652073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b622cae8-6f24-4b6c-83fb-1b31d1a3102c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149347 Oct 15 09:03:26.652567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 724/1440] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:03:27.676542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:27.677157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:27.683607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:27.684083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:27.684514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:27.685197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:27.685645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:27.686089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:27.811794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:27.819870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5367b599-1adb-462f-9f1c-f71033b562e1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147786 Oct 15 09:03:27.820439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 717/1441] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:27 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:28.843138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:28.843746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:28.850403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:28.850876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:28.851317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:28.851976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:28.852421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:28.852838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:28.979924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:28.988700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c9678fed-1a86-45ba-a445-b12ecc9349b0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149369 Oct 15 09:03:28.989252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 725/1442] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:28 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:30.010611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:30.011230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:30.018214 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:30.018696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:30.019132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:30.019820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:30.020273 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:30.020696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:30.023327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:30.147831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:30.155949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-10370a8f-3d0d-4c76-b91c-164cfcf2b282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149207 Oct 15 09:03:30.156701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 718/1443] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:30 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:31.179981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:31.180590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:31.187046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:31.187525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:31.187955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:31.188675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:31.189126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:31.189544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:31.313892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:31.322107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5a0337bf-0f89-48d1-b106-f8ddcd6f2fb3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145874 Oct 15 09:03:31.322661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 726/1444] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:32.344530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:32.345145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:32.352157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:32.352642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:32.353077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:32.353800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:32.354260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:32.354683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:32.491864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:32.502755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d259f11e-513e-4580-a3c8-9ebff58dfa5f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.162030 Oct 15 09:03:32.503453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 719/1445] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:33.525261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:33.525930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:33.532942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:33.533422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:33.533889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:33.534833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:33.535287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:33.535713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:33.664448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:33.672621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1db3305e-670e-48c6-a9d4-539260839723 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151186 Oct 15 09:03:33.673783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 727/1446] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:34.695762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:34.696379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:34.702757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:34.703236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:34.703668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:34.705015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:34.705474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:34.705927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:34.832412 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:34.840470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2b7edca5-05dd-43a8-9ff4-c7ee0b05298a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148468 Oct 15 09:03:34.841042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 720/1447] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:34 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:35.862928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:35.863538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:35.869899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:35.870370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:35.870803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:35.871486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:35.871937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:35.872408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:35.996939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:36.005860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-566dcc34-a2ec-4ff1-9b27-6ed847352f13 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146732 Oct 15 09:03:36.006423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 728/1448] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:37.029394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:37.030012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:37.037436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:37.037945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:37.038376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:37.039052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:37.039500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:37.039915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:37.164995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:37.173708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-da6e7e62-80a8-4743-8c9a-ae9e52334b38 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147814 Oct 15 09:03:37.174337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 721/1449] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:37 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:38.197822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:38.198432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:38.204766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:38.205278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:38.205840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:38.206596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:38.207043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:38.207461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:38.337596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:38.346521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1f8102a4-2edf-4ad2-b190-7074440cd52a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152720 Oct 15 09:03:38.347082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 729/1450] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:39.369252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:39.369900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:39.376886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:39.377441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:39.377822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:39.378510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:39.378969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:39.379393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:39.503543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:39.511605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bf20e726-1afb-4944-8da9-e573f0363559 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146203 Oct 15 09:03:39.512169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 722/1451] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:40.535927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:40.536529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:40.542914 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:40.543388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:40.543814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:40.544487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:40.544932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:40.545349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:40.672574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:40.680652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2e60b1aa-cfa1-482d-a01b-a50ec5f286c0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149476 Oct 15 09:03:40.681204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 730/1452] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:41.703518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:41.704092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:41.710549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:41.711021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:41.711447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:41.712124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:41.712573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:41.712996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:41.837463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:41.846137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3d84c854-b2f2-4d49-9d9c-46514a6b9364 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146546 Oct 15 09:03:41.846701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 723/1453] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:41 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:42.869476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:42.870093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:42.877180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:42.877716 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:42.878174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:42.878857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:42.879303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:42.879719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:43.008630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:43.016905 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-05362c1b-1f3b-4805-a470-e55ee626331e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151268 Oct 15 09:03:43.017788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 731/1454] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:44.039688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:44.040394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:44.046757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:44.047249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:44.048264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:44.049008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:44.049463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:44.049915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:44.172126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:44.180776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f6d9ba2a-01c3-4a3f-b40c-c92a6363db7b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.144929 Oct 15 09:03:44.181344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 724/1455] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:45.203432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:45.204064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:45.210406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:45.210879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:45.211309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:45.211983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:45.212434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:45.212851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:45.340454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:45.350599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b041b294-98e6-4d23-9515-f9ddb86fa391 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150918 Oct 15 09:03:45.351319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 732/1456] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:46.373057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:46.373702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:46.380108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:46.380584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:46.381013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:46.381705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:46.382246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:46.382599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:46.515013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:46.523580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-afeeb983-fffb-451d-8b80-153109878556 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154329 Oct 15 09:03:46.524146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 725/1457] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:47.546484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:47.547603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:47.553956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:47.554434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:47.554867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:47.555544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:47.555995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:47.556412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:47.684345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:47.692496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-967852c5-d100-4d30-ac57-d856182f514c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149806 Oct 15 09:03:47.693085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 733/1458] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:47 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:48.715723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:48.716282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:48.723179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:48.723654 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:48.724082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:48.724759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:48.725204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:48.725618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:49.099569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:49.107580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8fbfee87-8132-4cbe-9e5a-1b387b195ca3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.395768 Oct 15 09:03:49.108129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 726/1459] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:48 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:50.129895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:50.130511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:50.132904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:50.138356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:50.138848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:50.139286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:50.140005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:50.140465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:50.140967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:50.264977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:50.273543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6c0ba951-cd77-414c-b51a-7353a1aa01e0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147537 Oct 15 09:03:50.274123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 734/1460] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:51.297156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:51.297819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:51.300107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:51.305242 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:51.305822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:51.306254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:51.307333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:51.307442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:51.307763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:51.434917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:51.443753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2602a39f-765f-4ce3-94c7-34b67b209fdb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150398 Oct 15 09:03:51.444316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 727/1461] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:52.469902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:52.470489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:52.476772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:52.477251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:52.477713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:52.478397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:52.478848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:52.479267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:52.604698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:52.613710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9b6dbcf3-324e-4fc8-8f68-460106c55062 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148181 Oct 15 09:03:52.614352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 735/1462] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:53.636587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:53.637159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:53.643786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:53.644265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:53.644699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:53.645393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:53.645881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:53.646312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:53.789995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:53.798763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-87b16ba2-5079-4e83-930a-2c6b1667fcf8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.166128 Oct 15 09:03:53.799331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 728/1463] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:54.835405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:54.836026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:54.843656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:54.844755 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:54.845182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:54.846236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:54.846692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:54.847133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:55.153277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:55.165170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-536831e1-38e7-460c-8e23-fb6ff9e41fc3 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.347104 Oct 15 09:03:55.166046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 736/1464] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:54 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:56.188645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:56.189206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:56.195606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:56.196085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:56.196519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:56.197206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:56.197660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:56.198099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:56.370571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:56.378797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b3b5f6c0-3252-4c40-8be6-dbef1c815757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.194204 Oct 15 09:03:56.379365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 729/1465] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:56 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:57.402136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:57.402750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:57.409130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:57.409613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:57.410340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:57.411049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:57.411500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:57.411920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:57.415768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:03:57.540833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:57.549111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9e9545f2-e191-4add-ac41-60e774e5c89a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150780 Oct 15 09:03:57.549605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 737/1466] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:57 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:58.572575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:58.573192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:58.580106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:58.580574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:58.581000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:58.581702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:58.582144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:58.582558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:58.707107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:58.715150 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bb7a0cb3-702c-4300-bb05-237d8dba1f9e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146433 Oct 15 09:03:58.715715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 730/1467] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:58 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:03:59.739050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:03:59.739641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:03:59.746052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:59.746538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:59.746975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:59.747662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:03:59.748116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:03:59.748546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:03:59.875200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:03:59.883890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f8efed05-a34a-4f5d-86af-86fec2d6107b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148818 Oct 15 09:03:59.884451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 738/1468] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:03:59 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:00.907954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:00.908590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:00.915413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:00.915910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:00.916331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:00.917009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:00.917460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:00.917913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:00.920416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:01.044670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:01.053029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-abeed727-d530-45d3-b18b-3a71897f9ba5 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149597 Oct 15 09:04:01.053698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 731/1469] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:00 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:02.076167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:02.076777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:02.083964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:02.084449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:02.084882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:02.085574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:02.086069 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:02.086479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:02.240585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:02.248815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-415e5622-cbeb-451b-a4ca-ab9a9c74c1c1 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.176496 Oct 15 09:04:02.249371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 739/1470] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:02 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:03.272257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:03.272872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:03.279367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:03.279851 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:03.280282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:03.280976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:03.281428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:03.281959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:03.406065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:03.415076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2505d102-00d8-4282-b936-8bf0c13eac29 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146680 Oct 15 09:04:03.415652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 732/1471] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:03 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:04.438779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:04.439387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:04.445858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:04.446356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:04.446758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:04.447437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:04.447889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:04.448318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:04.573448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:04.582197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-255b559e-3684-472a-981e-59484bfb9381 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147274 Oct 15 09:04:04.582751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 740/1472] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:04 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:05.605794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:05.606421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:05.612978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:05.613459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:05.613928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:05.614621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:05.615080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:05.615505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:05.746108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:05.754735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-96153ea3-a719-4990-b3d0-1ea08b7728f9 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152822 Oct 15 09:04:05.755297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 733/1473] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:05 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:06.778057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:06.778671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:06.785094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:06.785575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:06.786035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:06.786721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:06.787172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:06.787598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:06.911050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:06.919259 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6dde5a0a-f719-40be-9ee3-c84b2122904d tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145104 Oct 15 09:04:06.919829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 741/1474] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:06 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:07.942737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:07.943351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:07.949276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:07.949783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:07.950215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:07.950896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:07.951347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:07.951766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:08.087248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:08.095859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5f197021-e18f-4134-a8a0-17c3456fa077 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.157209 Oct 15 09:04:08.096417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 734/1475] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:07 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:09.120093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:09.120704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:09.128388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:09.128862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:09.129293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:09.130019 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:09.130471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:09.130890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:09.255901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:09.264098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6de47807-4bfe-4927-89f7-f40004c53905 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147911 Oct 15 09:04:09.264664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 742/1476] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:09 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:10.288096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:10.288712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:10.295140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:10.295632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:10.296055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:10.296735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:10.297204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:10.297628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:10.423619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:10.431779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4a72c9c9-7aec-472c-a575-c08250b5b5a8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147777 Oct 15 09:04:10.432341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 735/1477] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:10 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:11.454544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:11.455156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:11.461567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:11.462075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:11.462509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:11.463189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:11.463639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:11.464062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:11.595362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:11.602146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-396c3fe6-48bc-43f4-9b6f-d522aa5dbedc tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151398 Oct 15 09:04:11.602725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 743/1478] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:11 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:12.626506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:12.627121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:12.633913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:12.634394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:12.634822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:12.635507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:12.635951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:12.636371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:12.768471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:12.777169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0787fec5-0577-4d14-9b90-8612b15c2ebd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154960 Oct 15 09:04:12.777996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 736/1479] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:12 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:13.799660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:13.800276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:13.806940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:13.807423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:13.807857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:13.808549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:13.809006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:13.809431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:13.938839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:13.946939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-22a280d9-9472-450d-8337-702434ab58a0 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151583 Oct 15 09:04:13.947498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 744/1480] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:13 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:14.969567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:14.970655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:14.977040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:14.977521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:14.977997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:14.978685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:14.979141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:14.979564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:15.104934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:15.113026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-32decc17-4f84-4507-9ce4-9f288ae42164 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147395 Oct 15 09:04:15.113595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 737/1481] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:14 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:16.135763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:16.136311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:16.143423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:16.143900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:16.144329 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:16.145010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:16.145458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:16.145904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:16.273202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:16.281333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7178c2fc-c13c-4e4a-b842-ea355564ce63 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149457 Oct 15 09:04:16.281921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 745/1482] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:16 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:17.305025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:17.305637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:17.312572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:17.313058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:17.313495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:17.314227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:17.314682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:17.315107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:17.445568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:17.454178 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17c22fdc-0430-465d-81af-a1e2cab2d757 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152909 Oct 15 09:04:17.454757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 738/1483] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:17 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:18.477145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:18.477724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:18.484097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:18.484576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:18.485010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:18.486242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:18.486695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:18.487114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:18.615295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:18.623648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-368b7072-ff91-482b-a08b-327b131b4923 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150425 Oct 15 09:04:18.624211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 746/1484] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:18 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:19.647955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:19.648562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:19.655058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:19.655471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:19.655895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:19.656573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:19.657023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:19.657471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:19.785745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:19.793872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e6ce47ac-4eda-4f19-b021-85ca75f4fe1e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149910 Oct 15 09:04:19.794435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 739/1485] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:19 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:20.817377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:20.818036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:20.820333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:20.825227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:20.825733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:20.826163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:20.826842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:20.827286 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:20.827701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:20.951408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:20.959543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-97fdf34d-eb3f-45d5-9bd9-e494260dbed2 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146617 Oct 15 09:04:20.960094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 747/1486] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:20 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:21.982113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:21.982721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:21.985068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:21.990258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:21.990731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:21.991159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:21.991837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:21.992284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:21.992699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:22.123725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:22.132582 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7720093e-0643-47e9-8512-126d4a879661 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.154269 Oct 15 09:04:22.145277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 740/1487] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:21 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:23.155909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:23.156523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:23.162979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:23.163460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:23.163892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:23.164580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:23.165028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:23.165450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:23.296398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:23.305134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84b0384e-842f-4f27-989b-ee974b9ba282 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153075 Oct 15 09:04:23.305700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 748/1488] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:23 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:24.328077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:24.328766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:24.336154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:24.336633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:24.337067 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:24.337780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:24.338233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:24.338649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:24.467538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:24.476244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e2e60817-fa11-4892-bc72-e7d9d2dede94 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151860 Oct 15 09:04:24.476833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 741/1489] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:24 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:25.499581 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:25.500185 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:25.507198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:25.507666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:25.508092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:25.508762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:25.509207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:25.509622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:25.637137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:25.645937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e071b031-524d-4a99-bb2b-fce0fcdc053a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150118 Oct 15 09:04:25.646496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 749/1490] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:25 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:26.669261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:26.669853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:26.676215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:26.676691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:26.677149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:26.677863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:26.678507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:26.678722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:26.962372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:26.970966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7f833cf9-464b-448a-bcbc-f87542589742 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.305656 Oct 15 09:04:26.971522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 742/1491] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:26 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:27.994463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:27.995075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:28.001968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:28.002446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:28.002875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:28.003556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:28.004005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:28.004432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:28.008272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=78 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:28.133513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:28.141662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cf09e59a-a961-4687-9cbb-e0ca5252fcdd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151134 Oct 15 09:04:28.142249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 750/1492] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:27 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:29.164920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:29.165534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:29.171950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:29.172428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:29.172863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:29.173545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:29.174027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:29.174455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:29.299168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:29.307391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f3941072-c84f-4f95-ad17-d81aaca4d128 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.146338 Oct 15 09:04:29.307954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 743/1493] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:29 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:30.330988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:30.331558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:30.337966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:30.338442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:30.338872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:30.339550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:30.339997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:30.340420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:30.469643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:30.477808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-17cd8f46-1a6d-4b55-85c2-d27154ccf3ec tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151314 Oct 15 09:04:30.478373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 751/1494] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:30 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:31.501933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:31.502578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:31.509005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:31.509522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:31.509991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:31.510680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:31.511136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:31.511560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:31.515400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=78 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:31.637562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:31.647189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-68bab7d3-65ac-436a-9302-a56df29c954b tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149474 Oct 15 09:04:31.647775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 744/1495] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:31 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:32.670610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:32.671156 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:32.678133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:32.678609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:32.679039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:32.679732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:32.680186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:32.680612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:32.814863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:32.823386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b2306406-d163-4154-aa52-d6d75b2e5236 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.156770 Oct 15 09:04:32.823954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 752/1496] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:32 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:33.846032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:33.846661 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:33.861155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:33.861155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:33.861155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:33.861155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:33.861507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:33.861507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:33.991446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:33.999730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f3107123-3e6f-440a-b3a7-7161d1cd6e30 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.158090 Oct 15 09:04:34.000290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 745/1497] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:33 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:35.022821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:35.023510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:35.029888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:35.030450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:35.030943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:35.031711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:35.032240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:35.032727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:35.157820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:35.166342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-97b51b88-16b0-4644-b139-f608da42d796 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147476 Oct 15 09:04:35.166904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 753/1498] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:35 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:36.189814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:36.190361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:36.196864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:36.197345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:36.197816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:36.198508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:36.198960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:36.199386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:36.326860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:36.335079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6db72220-a3af-4b3c-8af6-2c3cb67db22e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149230 Oct 15 09:04:36.335651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 746/1499] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:36 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:37.358468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:37.359090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:37.365228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:37.365740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:37.366182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:37.366867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:37.367324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:37.367751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:37.494152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:37.503224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b11f9993-8ac7-4a5b-82a0-239aa5a3bfd7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148474 Oct 15 09:04:37.503922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 754/1500] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:37 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:38.526992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:38.527663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:38.534082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:38.534559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:38.535240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:38.535952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:38.536398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:38.536819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:38.662619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:38.670631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0893d930-43eb-405b-a0dd-0d858d77892c tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147641 Oct 15 09:04:38.671188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 747/1501] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:38 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:39.692629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:39.693187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:39.699563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:39.700032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:39.700457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:39.701159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:39.701629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:39.702088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:39.832745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:39.840749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3e1a9d76-db24-46de-820e-d772bec0b50a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.152150 Oct 15 09:04:39.841309 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 755/1502] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:39 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:40.863615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:40.864224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:40.870614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:40.871091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:40.871517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:40.872194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:40.872643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:40.873066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:40.996338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:41.005058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3b70a6cf-6f51-457a-b035-d9114aa1d1b7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.145755 Oct 15 09:04:41.005618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 748/1503] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:40 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:42.028043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:42.028656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:42.035839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:42.036313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:42.036745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:42.037424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:42.037912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:42.038332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:42.166669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:42.175469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-11bf2f19-e91d-454e-a999-1d3450e9d037 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.151272 Oct 15 09:04:42.176028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 756/1504] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:42 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:43.198243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:43.198854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:43.205220 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:43.205725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:43.206164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:43.206855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:43.207303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:43.207721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:43.334022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:43.341381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2bb7e865-0588-4c32-8cee-9f1bb167904f tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147025 Oct 15 09:04:43.341974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 749/1505] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:43 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:44.364786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:44.365398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:44.371939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:44.372416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:44.372844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:44.373525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:44.373997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:44.374411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:44.506145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:44.514294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1a292e24-884f-48cf-b9a4-b73e91b76333 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.153282 Oct 15 09:04:44.514855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 757/1506] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:44 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:45.537046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:45.537698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:45.544435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:45.544909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:45.545339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:45.546047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:45.546523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:45.546911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:45.673625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:45.681988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2357ef27-4ef2-4810-b32d-938ffb95ffa7 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149004 Oct 15 09:04:45.682553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 750/1507] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:45 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:46.704492 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:46.705098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:46.711625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:46.712137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:46.712569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:46.713252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:46.713729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:46.714155 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:46.840292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:46.849108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f7e5f7e6-ee06-4bcc-b5d5-a679dbf3b0dd tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148602 Oct 15 09:04:46.849663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 758/1508] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:46 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:47.871930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:47.872549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:47.879664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:47.880144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:47.880576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:47.881300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:47.881808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:47.882233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:48.009863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:48.017976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6c56f480-7d58-4677-b116-f2127ea20d5a tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149843 Oct 15 09:04:48.018544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 751/1509] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:47 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:49.040489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:49.041129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:49.048278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:49.048758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:49.049189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:49.049910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:49.050359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:49.050783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:49.177350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:49.185548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9d77bfa3-97e8-4bcf-8132-05d0a0c3b6cb tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.148894 Oct 15 09:04:49.186175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 759/1510] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:49 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:50.208271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:50.208811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:50.215140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:50.215621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:50.216054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:50.216744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:50.217196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:50.217617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:50.346266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:50.354431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f1fec275-f8ad-4024-93af-9c8c75091609 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150093 Oct 15 09:04:50.354995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 752/1511] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:50 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:51.378941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:51.379488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:51.382023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=26 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:51.387681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:51.388202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:51.388632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:51.389325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:51.389807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:51.390232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:51.517395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:51.525554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-58176240-de15-4244-9466-e7415b50bd2e tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.150591 Oct 15 09:04:51.526143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 760/1512] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:51 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:52.550091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:52.550703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:52.553048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=26 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:04:52.558446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:52.558921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:52.559349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:52.560027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:52.560472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:52.560889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:52.685017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:52.693204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cb3bc963-aac4-4a4d-b7c9-bb518630dcd8 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.147617 Oct 15 09:04:52.693795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 753/1513] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:52 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:53.716095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:53.716711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:53.723064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:53.723547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:53.723984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:53.724670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:53.725127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:53.725551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:53.852837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:53.861726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f7d4270-577f-474f-8327-05a6524bde83 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.149428 Oct 15 09:04:53.862282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 761/1514] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:53 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:04:54.885159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:04:54.885784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] [instance: 83c9eb9c-612a-4b42-8103-e2bb037d1f39] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:04:54.888166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:04:54.888304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 (ip 10.222.0.30) !!! Oct 15 09:04:54.889317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:04:54.889439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 (ip 10.222.0.30) !!! Oct 15 09:04:54.899427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:54.899914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:54.900365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:54.901049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:04:54.901497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:04:54.901940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:04:55.030338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd716aed1f7684cda9b82ba0d5c3d24d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c350a7b4ae944c188fc8af5a91438f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:04:55.039307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e263775e-0e57-43f0-aa05-2f1c78fa4b10 tempest-VolumesSnapshotTestJSON-1495415652 tempest-VolumesSnapshotTestJSON-1495415652-project] 10.222.0.30 "GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39" status: 200 len: 1560 microversion: 2.1 time: 0.158053 Oct 15 09:04:55.039869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 754/1515] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:04:54 2022] GET /compute/v2.1/servers/83c9eb9c-612a-4b42-8103-e2bb037d1f39 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:05:51.086563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:51.087145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:51.089356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:05:51.090462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=71 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:05:51.091242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:05:51.091406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a (ip 10.222.0.30) !!! Oct 15 09:05:51.106651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:51.107285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:51.107915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:51.108975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:51.109517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:51.124708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:51.151154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:05:51.230981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e605b2ca-4aff-43a9-8248-72a8c30ab8ac tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 204 len: 0 microversion: 2.1 time: 0.148318 Oct 15 09:05:51.231567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 762/1516] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:05:51 2022] DELETE /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:05:51.240408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:51.241030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:51.243383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:05:51.244079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=65 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:05:51.245646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:05:51.245846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:05:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a (ip 10.222.0.30) !!! Oct 15 09:05:51.255842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:51.256329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:51.256762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:51.257457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:51.257939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:51.258357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:51.385153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:05:51.393502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-82c439c4-b859-43cc-8cca-e31155d4d312 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1508 microversion: 2.1 time: 0.157042 Oct 15 09:05:51.394107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 755/1517] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:51 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:05:52.292627 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a", "name": "network-vif-deleted", "tag": "b6bb83b5-c727-4796-a835-696ea9d3ca06"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:05:52.302580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:52.303050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:52.303560 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:52.315173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] Creating event network-vif-deleted:b6bb83b5-c727-4796-a835-696ea9d3ca06 for instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a on hv-cinder-85697 Oct 15 09:05:52.320347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-a2bc2641-bf29-4a5d-b7b5-f52297d82582 req-3d3ac824-368a-4d5b-b789-c6359c6edd9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123575 Oct 15 09:05:52.320938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 763/1518] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:05:52.416334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:52.416948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:52.424101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:52.424705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:52.425195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:52.425928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:52.426387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:52.426815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:52.458543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:52.459038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:52.459558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:52.460005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lazy-loading 'fault' on Instance uuid 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:05:52.507359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:05:52.515738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-90485251-5fd7-436e-960c-c72eb40a1966 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 200 len: 1312 microversion: 2.1 time: 0.103109 Oct 15 09:05:52.516326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 756/1519] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:52 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:05:53.541642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:53.542369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:53.549295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.549804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.550236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.550919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.551367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.551784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.564852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] HTTP exception thrown: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Request method failure captured: Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a HTTP/1.1 Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL4Fl4WOwKbjND5c9pmR9PXLjRefQ9qg1p4lrjbZuVHG-rAeZn1P4K65sLTWqijuhFBZ1H0WqGElufJd0rjJDDNUM2Ug6fFXNkwrbusshlo3SMtntWfM5eM3EIgyt3FNcC8yLLJeNThQXkZbtIAQ4cgZctVLzIRxG10RoQ9Xlg_Gvg Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:05:53.566481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f67051bce2414ff791a2a1e1a638cadc", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 9cc9e2cf11804cc39a7de3c314e46679 Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. Oct 15 09:05:53.568319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a'} Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:05:53.569361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. Oct 15 09:05:53.571088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:05:53.572710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Returning 404 to user: Instance 7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:05:53.572710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bb7566d9-820e-4ae1-9930-effd5ba7a200 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a" status: 404 len: 111 microversion: 2.1 time: 0.030905 Oct 15 09:05:53.572710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 764/1520] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:53 2022] GET /compute/v2.1/servers/7e4e5bce-abd0-4bd9-84ed-1e9a6bdc534a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:05:53.577233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:53.577842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:53.584793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.585272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.585729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.586413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.586862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.587283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.612800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:05:53.687960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2d5e6cef-1c94-4eef-91f0-4da7c2c46998 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "DELETE /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 204 len: 0 microversion: 2.1 time: 0.114151 Oct 15 09:05:53.688573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 757/1521] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:05:53 2022] DELETE /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:05:53.696846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:53.697495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:53.703377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.703860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.704299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.704984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:53.705446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:53.705903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:53.831748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:05:53.839479 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2f4dd890-3c83-4d8c-ab3d-88608243c493 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1521 microversion: 2.1 time: 0.146437 Oct 15 09:05:53.840036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 765/1522] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:53 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:05:54.555210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60a56b6e-d8d1-4f32-b72f-d1d4135779ff", "name": "network-vif-deleted", "tag": "3f77bbb2-7bc9-473d-89cb-ab29502af0a6"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:05:54.564689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:54.565163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:54.565591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:54.576844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] Creating event network-vif-deleted:3f77bbb2-7bc9-473d-89cb-ab29502af0a6 for instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff on hv-cinder-85697 Oct 15 09:05:54.582115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-3da103c7-0d4b-478b-aba6-1d001822758b req-9726cce3-e662-416b-92cd-b68c01a20451 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030957 Oct 15 09:05:54.582789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 758/1523] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:05:54.863168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:54.863787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:54.870410 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:54.870894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:54.871327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:54.872017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:54.872469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:54.872892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:54.906393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:54.906885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:54.907314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:54.907758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lazy-loading 'fault' on Instance uuid 60a56b6e-d8d1-4f32-b72f-d1d4135779ff {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:05:54.949422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc9e2cf11804cc39a7de3c314e46679', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67051bce2414ff791a2a1e1a638cadc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:05:54.957923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bc3a9d1d-8159-4b5a-bf29-017909a4428b tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 200 len: 1311 microversion: 2.1 time: 0.098532 Oct 15 09:05:54.958806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 766/1524] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:54 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:05:55.981239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:05:55.981963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] [instance: 60a56b6e-d8d1-4f32-b72f-d1d4135779ff] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:05:55.988573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:55.989049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:55.989482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:55.990197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:05:55.990653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:05:55.991079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:05:56.004669 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] HTTP exception thrown: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Request method failure captured: Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff HTTP/1.1 Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL4Fl4WOwKbjND5c9pmR9PXLjRefQ9qg1p4lrjbZuVHG-rAeZn1P4K65sLTWqijuhFBZ1H0WqGElufJd0rjJDDNUM2Ug6fFXNkwrbusshlo3SMtntWfM5eM3EIgyt3FNcC8yLLJeNThQXkZbtIAQ4cgZctVLzIRxG10RoQ9Xlg_Gvg Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:05:56.006290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f67051bce2414ff791a2a1e1a638cadc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f67051bce2414ff791a2a1e1a638cadc", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: f67051bce2414ff791a2a1e1a638cadc Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-200548330 Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 9cc9e2cf11804cc39a7de3c314e46679 Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-ServerRescueNegativeTestJSON-200548330-project Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. Oct 15 09:05:56.008032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '60a56b6e-d8d1-4f32-b72f-d1d4135779ff'} Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:05:56.009239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. Oct 15 09:05:56.010932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:05:56.012682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] Returning 404 to user: Instance 60a56b6e-d8d1-4f32-b72f-d1d4135779ff could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:05:56.012682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-23fc39b3-e8fd-4ab6-8ac2-9212ff47c270 tempest-ServerRescueNegativeTestJSON-200548330 tempest-ServerRescueNegativeTestJSON-200548330-project] 10.222.0.30 "GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff" status: 404 len: 111 microversion: 2.1 time: 0.031106 Oct 15 09:05:56.012682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 759/1525] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:05:55 2022] GET /compute/v2.1/servers/60a56b6e-d8d1-4f32-b72f-d1d4135779ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:06:00.940840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-036c7abc-7ab9-4274-bfdb-ea8f58986230 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Action: 'create', calling method: .version_select at 0x7f575e5e3af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1220027051", "metadata": {"Type": "work"}}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:06:01.216546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-036c7abc-7ab9-4274-bfdb-ea8f58986230 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.393149 Oct 15 09:06:01.219242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 767/1526] 10.222.0.30 () {60 vars in 1156 bytes} [Sat Oct 15 09:06:00 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 15 09:06:01.231017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1805d5cd-f727-41ee-a81c-819a879d4794 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e1940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:01.282419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1805d5cd-f727-41ee-a81c-819a879d4794 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.055369 Oct 15 09:06:01.282994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 760/1527] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:01 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:02.297274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-55b4bccf-ac5e-406c-85e8-376242f41927 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575acf4040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:02.345208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-55b4bccf-ac5e-406c-85e8-376242f41927 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.052453 Oct 15 09:06:02.346076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 768/1528] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:02 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:03.360752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4bad3558-3652-4f8d-9462-6df7a12da1b7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a99f550>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:03.407069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4bad3558-3652-4f8d-9462-6df7a12da1b7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051131 Oct 15 09:06:03.407614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 761/1529] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:03 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:04.422294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-aca7677e-3dba-4bf8-9c3f-6df97fdbaf56 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adf24c0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:04.467017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-aca7677e-3dba-4bf8-9c3f-6df97fdbaf56 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049421 Oct 15 09:06:04.467563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 769/1530] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:04 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:05.481594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3f44441f-f533-46e3-bcdb-c5d593388d3c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0c700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:05.526637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3f44441f-f533-46e3-bcdb-c5d593388d3c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049367 Oct 15 09:06:05.527219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 762/1531] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:05 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:06.538837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:06.539640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:06.544123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dc9ff183-5d95-4d1f-a9c7-b80ab8f48a00 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b046790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:06.592084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dc9ff183-5d95-4d1f-a9c7-b80ab8f48a00 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.054018 Oct 15 09:06:06.592676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 770/1532] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:06 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:07.603881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:07.604643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:07.609287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca64e069-fcec-4dee-ac80-1a8bd12e9e09 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e23a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:07.655868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca64e069-fcec-4dee-ac80-1a8bd12e9e09 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.052733 Oct 15 09:06:07.656433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 763/1533] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:07 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:08.670736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0fe82805-b00f-4c35-a060-020ac71334b4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e6578b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:08.717145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0fe82805-b00f-4c35-a060-020ac71334b4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050698 Oct 15 09:06:08.717711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 771/1534] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:08 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:09.732660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8e936f67-be4b-4f76-8d81-d29422e14e54 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aeabc10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:09.780396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8e936f67-be4b-4f76-8d81-d29422e14e54 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.052050 Oct 15 09:06:09.781498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 764/1535] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:09 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:10.795920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-30e7fa15-f8eb-47fb-8c0f-7042cf1eecea tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e33a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:10.841361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-30e7fa15-f8eb-47fb-8c0f-7042cf1eecea tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049612 Oct 15 09:06:10.841953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 772/1536] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:10 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:11.856136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc166a59-07c8-4625-9b87-4ce4ca0bc7b0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9b3a60>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:11.901266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc166a59-07c8-4625-9b87-4ce4ca0bc7b0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049510 Oct 15 09:06:11.901916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 765/1537] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:11 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:12.916996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5d68c7d7-d5b5-42cf-8a90-aa225d45305c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575acb7040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:12.963077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5d68c7d7-d5b5-42cf-8a90-aa225d45305c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050463 Oct 15 09:06:12.963625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 773/1538] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:12 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:13.978403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f95c5ade-ffee-45bb-a72d-7637912ec92a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:14.023834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f95c5ade-ffee-45bb-a72d-7637912ec92a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049711 Oct 15 09:06:14.024384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 766/1539] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:13 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:15.039353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0917f00d-5881-4631-91c2-48749ccbd3cd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac90790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:15.085301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0917f00d-5881-4631-91c2-48749ccbd3cd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050990 Oct 15 09:06:15.085878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 774/1540] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:15 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:16.099901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0aa55c06-cd5e-44f7-91f4-bc53dbe3d46c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0ce50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:16.146155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0aa55c06-cd5e-44f7-91f4-bc53dbe3d46c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050426 Oct 15 09:06:16.146730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 767/1541] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:16 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:17.161070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6d7d4334-dc98-40a3-863e-34e8ac16172d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae0eca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:17.207126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6d7d4334-dc98-40a3-863e-34e8ac16172d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050667 Oct 15 09:06:17.207699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 775/1542] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:17 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:18.221906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c74f1b61-ac47-4c33-89b3-1ae08e542a94 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:18.269144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c74f1b61-ac47-4c33-89b3-1ae08e542a94 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051644 Oct 15 09:06:18.269730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 768/1543] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:18 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:19.283828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-991884bf-bcb1-45c8-b763-e189d3032928 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e2550>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:19.330140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-991884bf-bcb1-45c8-b763-e189d3032928 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050568 Oct 15 09:06:19.330689 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 776/1544] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:19 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:20.344727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-56375ed0-42cc-4e94-bcf0-3cc5184ad4b8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e1430>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:20.390544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-56375ed0-42cc-4e94-bcf0-3cc5184ad4b8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049464 Oct 15 09:06:20.391144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 769/1545] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:20 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:21.404728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1fba478c-be5d-4a99-86b7-c37399b1e1f2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e610d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:21.450709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1fba478c-be5d-4a99-86b7-c37399b1e1f2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050230 Oct 15 09:06:21.451262 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 777/1546] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:21 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:22.465277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-db8f6ea2-03ff-4110-94a8-5bd3eb865089 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa8a1f0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:22.512563 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-db8f6ea2-03ff-4110-94a8-5bd3eb865089 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051670 Oct 15 09:06:22.513134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 770/1547] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:22 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:23.528125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef2d760c-dd66-46c1-a8a2-53541eed4d1b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e638820>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:23.573816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef2d760c-dd66-46c1-a8a2-53541eed4d1b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050025 Oct 15 09:06:23.574362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 778/1548] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:23 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:24.588859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7d698f32-b26d-49c1-ad4e-fbd3f26f0a4e tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9b34c0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:24.635790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7d698f32-b26d-49c1-ad4e-fbd3f26f0a4e tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051206 Oct 15 09:06:24.636357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 771/1549] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:24 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:25.647615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:06:25.648102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:06:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:06:25.653000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-509469f4-110d-42e8-a958-a3d8e4886460 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575acb7e50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:25.700994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-509469f4-110d-42e8-a958-a3d8e4886460 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.054162 Oct 15 09:06:25.701556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 779/1550] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:25 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:26.715768 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dc3e992e-c338-4fa7-8189-da8e675d3c44 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2a60>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:26.762513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dc3e992e-c338-4fa7-8189-da8e675d3c44 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050951 Oct 15 09:06:26.763081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 772/1551] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:26 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:27.777402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5df1a5c8-9249-4304-9d7a-ec02e404f16c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e6105e0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:27.822529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5df1a5c8-9249-4304-9d7a-ec02e404f16c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049737 Oct 15 09:06:27.823110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 780/1552] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:27 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:28.838005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c4adf0bb-b49f-4c83-81bc-9c0b012a2963 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa8a310>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:28.884268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c4adf0bb-b49f-4c83-81bc-9c0b012a2963 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050734 Oct 15 09:06:28.884862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 773/1553] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:28 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:29.898953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5416c766-b5eb-48f9-98d4-cdfebac796a6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575acca700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:29.944838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5416c766-b5eb-48f9-98d4-cdfebac796a6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050078 Oct 15 09:06:29.945394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 781/1554] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:29 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:30.959663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-63ea660c-1d05-4bd7-a272-98856dbbd9e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e28b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:31.004425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-63ea660c-1d05-4bd7-a272-98856dbbd9e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049053 Oct 15 09:06:31.004978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 774/1555] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:30 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:31.255533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:31.256008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:31.262617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:31.263100 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:31.263534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:31.264225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:31.264708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:31.265136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:31.292012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:06:31.373167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f500875a-f579-4a94-a8aa-781e7b0b24a0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 204 len: 0 microversion: 2.1 time: 0.121693 Oct 15 09:06:31.376151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 782/1556] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:06:31 2022] DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:06:31.382920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:31.383592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:31.390016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:31.390497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:31.390926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:31.391613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:31.392065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:31.392482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:31.522617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:31.531245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86c08dfb-bd24-4b7d-bb1b-4ead02151319 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1720 microversion: 2.1 time: 0.152312 Oct 15 09:06:31.531804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 775/1557] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:06:32.019007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f036b79b-bec6-4d9c-b4c1-668f83c96190 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5f5e50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:32.025797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:06:32.025936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:06:32.068620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f036b79b-bec6-4d9c-b4c1-668f83c96190 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.054256 Oct 15 09:06:32.069184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 783/1558] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:32 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:32.555293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:32.555849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:32.562627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:32.563117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:32.563552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:32.564246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:32.564699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:32.565122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:32.661111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:32.669270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-afa4675c-72fe-451f-9e1a-9bd9e098ce5c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1652 microversion: 2.1 time: 0.117974 Oct 15 09:06:32.669860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 776/1559] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1652 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:06:32.783292 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fe6c8c-4787-4c73-8993-3bcb42cf1e4a", "name": "network-vif-deleted", "tag": "3b5d8ee5-126d-4bd3-a3d0-928e5922b384"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:06:32.794150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:32.794630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:32.795054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:32.806111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] Creating event network-vif-deleted:3b5d8ee5-126d-4bd3-a3d0-928e5922b384 for instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a on hv-cinder-85697 Oct 15 09:06:32.811656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-7020a555-aa4a-46b8-9e89-41030224403e req-87603194-35f7-446c-afa4-6aab3e08fe2d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 Oct 15 09:06:32.812568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 784/1560] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:06:33.082459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9d5f3c33-d484-4c69-a7d4-5e280b64ad31 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a99f550>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:33.693644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:33.694384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:33.700481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:33.700961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:33.701398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:33.702725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:33.703188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:33.703615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:33.768199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:33.777154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b9b6d41c-ef4a-489a-a6fb-d0aac6f027a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087916 Oct 15 09:06:33.777742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 785/1561] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:34.800926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:34.801590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:34.807873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:34.808352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:34.808777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:34.809455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:34.809945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:34.810366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:34.872921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:34.881639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fddb4a95-b98a-462c-a14e-47fabd18cace tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084594 Oct 15 09:06:34.882215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 786/1562] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:35.904238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:35.904877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:35.911459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:35.911939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:35.912373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:35.913070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:35.913524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:35.914005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:35.974696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:35.982737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e00a1951-be39-4571-a372-34fc3d29a1c1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082408 Oct 15 09:06:35.983929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 787/1563] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:37.006117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:37.006791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:37.012820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:37.013298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:37.013767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:37.015101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:37.015556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:37.015981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:37.078700 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:37.086837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-38656125-28c5-4c68-b965-6c2c22a7d53b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084618 Oct 15 09:06:37.087390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 788/1564] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:38.109863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:38.110550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:38.116802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:38.117277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:38.117732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:38.118416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:38.118868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:38.119291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:38.181216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:38.190031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b96fe05a-7b2e-4146-9dc8-e147339ca59a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084001 Oct 15 09:06:38.190595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 789/1565] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:39.213852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:39.214548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:39.221278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:39.221792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:39.222225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:39.222960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:39.223412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:39.223833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:39.284457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:39.292804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8592968d-a36c-41fb-be95-d2a658fdff50 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082861 Oct 15 09:06:39.293359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 790/1566] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:40.316629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:40.317282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:40.323592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:40.324076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:40.324510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:40.325195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:40.325649 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:40.326101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:40.386110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:40.394440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-94524f06-a26d-428f-aceb-7f5b6dd84570 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081671 Oct 15 09:06:40.395002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 791/1567] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:06:41.417405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:41.418041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:41.424921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:41.425394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:41.425859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:41.426543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:41.426988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:41.427402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:41.489580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:41.497947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0ccc6099-788b-4882-b4f0-4d6b18eacca3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084336 Oct 15 09:06:41.498501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 792/1568] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:42.520474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:42.521158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:42.527377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:42.527856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:42.528284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:42.528964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:42.529412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:42.529870 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:42.559782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:42.592347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:42.600571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c9374846-391e-4fdb-8524-b2b982dc8a6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083917 Oct 15 09:06:42.601136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 793/1569] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:42.665560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=12 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:43.623970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:43.625099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:43.631613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:43.632091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:43.632522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:43.633202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:43.633655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:43.634098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:43.694154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:43.702134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-07b9a685-a319-41e2-8aa1-af5fd4633b33 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082016 Oct 15 09:06:43.703313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 794/1570] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:44.725497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:44.726159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:44.732360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:44.732835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:44.733263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:44.734007 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:44.734524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:44.734950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:44.794978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:44.803618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-59bfae5b-59a8-49be-887a-35dc404fc114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082010 Oct 15 09:06:44.804175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 795/1571] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:45.826858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:45.827490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:45.834478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:45.834958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:45.835389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:45.836070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:45.836517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:45.836939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:45.899935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:45.908097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e0dd91cc-9383-4007-97a4-4bddcb2972ff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085096 Oct 15 09:06:45.908653 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 796/1572] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:46.930736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:46.931391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:46.938318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:46.938798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:46.939233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:46.939913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:46.940364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:46.940787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:47.001994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:47.010061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fbdb2d4e-f7fe-4e77-a4a4-ea1f70887650 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083202 Oct 15 09:06:47.010619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 797/1573] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:48.033002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:48.033640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:48.040233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:48.040714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:48.041148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:48.041862 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:48.042319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:48.042744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:48.061177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:48.104734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:48.113457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4f8db685-7cb4-4afd-a434-099b4cefe4de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084989 Oct 15 09:06:48.114041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 798/1574] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:49.136220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:49.136950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:49.143660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:49.144129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:49.144552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:49.145225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:49.145670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:49.146109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:49.210361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:49.218429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b6c2855c-d7b7-41b4-87e4-b99897e80abc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085980 Oct 15 09:06:49.219000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 799/1575] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:50.240920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:50.241597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:50.248004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:50.248487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:50.248922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:50.249710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:50.250163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:50.250589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:50.312947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:50.321164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1628f3db-b18b-449d-8036-e8ece781ff58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084144 Oct 15 09:06:50.321739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 800/1576] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:51.344456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:51.345144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:51.351469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:51.351943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:51.352378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:51.353058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:51.353511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:51.354025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:51.414645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:51.423388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a9587e72-784f-4034-b971-5f0bd529c720 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083421 Oct 15 09:06:51.423937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 801/1577] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:52.447468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:52.448106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:52.455064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:52.455540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:52.455971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:52.456657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:52.457105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:52.457524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:52.518750 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:52.526805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5461bae1-6fc6-41ed-95b7-1b9ae73a10c0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083271 Oct 15 09:06:52.527365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 802/1578] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:53.550176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:53.550771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:53.557197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:53.557686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:53.558136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:53.558819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:53.559278 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:53.559701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:53.619488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:53.628402 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9fc84cb0-ade7-4218-b579-c0156f84aa87 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082684 Oct 15 09:06:53.628972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 803/1579] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:54.651191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:54.651887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:54.658520 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:54.659003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:54.659438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:54.660124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:54.660577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:54.661000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:54.723681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:54.731751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6445c372-dd01-4194-a58d-815b1d4b6fc0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085211 Oct 15 09:06:54.732316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 804/1580] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:55.754283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:55.754921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:55.761244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:55.761751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:55.762188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:55.762880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:55.763334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:55.763756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:55.823735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:55.832268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fea20d5b-f11c-4542-a10e-003cee8d457d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081824 Oct 15 09:06:55.832831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 805/1581] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:56.855220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:56.855907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:56.862743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:56.863216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:56.863644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:56.864323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:56.864774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:56.865212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:56.956675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:56.965043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fa7e8278-4b00-411e-9581-4a44cb09e79e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.113612 Oct 15 09:06:56.965546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 806/1582] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:57.988267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:57.988967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:57.991159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:06:57.996303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:57.996780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:57.997211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:57.997932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:57.998384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:57.998803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:58.059650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:58.067656 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8c4ba604-ccf0-46ca-9825-f6ea9406a9f1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083810 Oct 15 09:06:58.068214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 807/1583] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:06:59.090852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:06:59.091538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:06:59.097892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:59.098370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:59.098798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:59.099477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:06:59.099927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:06:59.100350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:06:59.164237 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:06:59.173000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1cc30118-6709-4a53-90a7-671aa2bed40c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086018 Oct 15 09:06:59.173551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 808/1584] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:06:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:00.195709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:00.196367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:00.202601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:00.204345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:00.204816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:00.205509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:00.205990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:00.206417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:00.266827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:00.275028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7804024c-a3f3-4966-9b9a-f9d71c6388c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083254 Oct 15 09:07:00.275589 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 809/1585] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:01.297239 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:01.297940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:01.304288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:01.304769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:01.305204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:01.305994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:01.306454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:01.306879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:01.366810 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:01.375553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-33596798-6053-4df8-8635-7db585dac592 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081706 Oct 15 09:07:01.376113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 810/1586] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:02.398415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:02.399031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:02.405423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:02.405938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:02.406884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:02.407566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:02.408018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:02.408442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:02.469519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:02.478249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3585ae93-267d-4ffa-ba24-a3b312e3591f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083835 Oct 15 09:07:02.479015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 811/1587] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:03.503428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:03.504043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:03.510465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:03.510945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:03.511375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:03.512057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:03.512507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:03.512927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:03.578787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:03.587103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-89718dde-c15c-41dd-9046-2c65527a2b02 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.088216 Oct 15 09:07:03.587657 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 812/1588] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:04.610110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:04.610755 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:04.617009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:04.617484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:04.617940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:04.618611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:04.619058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:04.619473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:04.680962 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:04.689779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ac531836-94ab-4950-9adc-7a6308ce2e43 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083803 Oct 15 09:07:04.690328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 813/1589] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:05.713112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:05.713725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:05.720855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:05.721328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:05.721780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:05.722469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:05.722915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:05.723332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:05.783118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:05.791515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2eb238d-69f6-4095-8244-1ca23e43e183 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082392 Oct 15 09:07:05.792074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 814/1590] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:06.815343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:06.816001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:06.821821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:06.822295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:06.822718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:06.823389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:06.823834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:06.824247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:06.828724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:06.883389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:06.892087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ea6a5923-37cf-4094-aa0c-a6fdf900bf66 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081351 Oct 15 09:07:06.892638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 815/1591] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:07.914935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:07.915570 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:07.921860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:07.922336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:07.922761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:07.923434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:07.923885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:07.924300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:07.986752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:07.994798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bc97ef32-c5b6-412f-8cd3-774af67528f2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083965 Oct 15 09:07:07.995349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 816/1592] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:09.016628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:09.017298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:09.023711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:09.024191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:09.024622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:09.025306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:09.025786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:09.026212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:09.087385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:09.096057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-21543aa0-c7ab-43a2-b696-1564c44fb86c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083285 Oct 15 09:07:09.096615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 817/1593] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:10.119443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:10.120199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:10.127096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:10.127571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:10.127993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:10.128668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:10.129115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:10.129529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:10.189103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:10.197148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-03615610-987e-4bfd-843d-dcee09cef114 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081549 Oct 15 09:07:10.197726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 818/1594] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:11.220801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:11.221484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:11.227713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:11.228188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:11.228634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:11.229318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:11.229791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:11.230213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:11.292190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:11.301014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8050b78d-1578-45af-96c6-14d4d6248f28 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084721 Oct 15 09:07:11.301568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 819/1595] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:12.322816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:12.323489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:12.329965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:12.330447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:12.330885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:12.331571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:12.332053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:12.332482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:12.394949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:12.403216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-856d0171-cb9c-4c2e-892e-4ab4ef14bd32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084302 Oct 15 09:07:12.403774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 820/1596] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:13.427433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:13.428061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:13.434447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:13.434930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:13.435366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:13.436052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:13.436512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:13.437446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:13.497093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:13.505975 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-47463577-a11e-4f5c-aa8f-de3c642c8ae9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082333 Oct 15 09:07:13.506493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 821/1597] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:14.529170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:14.529878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:14.537101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:14.537587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:14.538051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:14.538740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:14.539196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:14.539623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:14.599337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:14.607374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b4f91222-90ad-436d-8b4a-758f4df366f3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082047 Oct 15 09:07:14.607917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 822/1598] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:15.630085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:15.630696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:15.637465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:15.637983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:15.638432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:15.639104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:15.639562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:15.640604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:15.699645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:15.708465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3ff1708a-9364-4238-93fd-d6d98fb7d1c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082300 Oct 15 09:07:15.709020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 823/1599] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:16.730762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:16.731396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:16.738440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:16.738924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:16.739357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:16.740118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:16.740706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:16.741194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:16.804126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:16.812256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a23e4e6a-2ed4-488e-90ee-82b9e64f878c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085388 Oct 15 09:07:16.812805 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 824/1600] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:17.834913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:17.835624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:17.842044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:17.842525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:17.842955 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:17.843641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:17.844092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:17.844513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:17.904083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:17.912943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4551e608-0427-490c-8794-e5edc088b19c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081885 Oct 15 09:07:17.913496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 825/1601] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:18.936061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:18.936730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:18.943564 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:18.944038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:18.944463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:18.945135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:18.945604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:18.946022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:19.006949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:19.015588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bb7c8c8a-6481-4650-83f0-d916ea45ad7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082744 Oct 15 09:07:19.016152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 826/1602] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:20.038314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:20.038957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:20.045324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:20.045835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:20.046269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:20.046949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:20.047400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:20.047827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:20.107838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:20.116122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7b0b1018-7e01-4b16-ab0c-9f6f00eb5ba2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081891 Oct 15 09:07:20.116688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 827/1603] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:21.139927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:21.140565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:21.146950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:21.147423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:21.147851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:21.148523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:21.148969 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:21.149384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:21.211056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:21.219583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8026e1e2-02c9-4a27-8127-73a2e1e7c277 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083554 Oct 15 09:07:21.220134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 828/1604] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:22.242559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:22.243241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:22.250199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:22.250684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:22.251115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:22.251799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:22.252252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:22.252675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:22.311496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:22.320142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2fa0ef5f-598f-4165-b24a-3a37b173cb76 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081385 Oct 15 09:07:22.320695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 829/1605] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:23.343687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:23.344463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:23.350610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:23.351082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:23.351509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:23.352220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:23.352668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:23.353083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:23.413717 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:23.422055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-78849b1a-d616-4a5c-9cdb-6d83355f4f3a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082867 Oct 15 09:07:23.422611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 830/1606] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:24.445195 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:24.445851 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:24.452723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:24.453209 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:24.453640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:24.454378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:24.454830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:24.455252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:24.514212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:24.518117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:24.523529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b7b3efb0-c30e-4c79-a036-1362d03e2fc7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082176 Oct 15 09:07:24.524084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 831/1607] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:25.547583 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:25.548190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:25.554737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:25.555214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:25.555647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:25.556323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:25.556778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:25.557197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:25.621876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:25.630178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2c565a76-45be-46bc-afc1-8606a85b7d81 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087049 Oct 15 09:07:25.630729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 832/1608] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:26.652587 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:26.653244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:26.659727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:26.660205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:26.660633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:26.661340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:26.662084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:26.662527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:26.722760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:26.730886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-db067559-c50f-4843-8e76-23aa503508d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082329 Oct 15 09:07:26.731446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 833/1609] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:27.753585 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:27.754285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:27.760593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:27.761071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:27.761505 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:27.762217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:27.762670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:27.763092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:27.822766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:27.830836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a408bac7-e0d2-46a8-8279-a4bd312ef2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081153 Oct 15 09:07:27.831398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 834/1610] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:28.854176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:28.854837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:28.856984 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=56 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:28.862706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:28.863189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:28.863620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:28.864304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:28.864757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:28.865180 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:28.925211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:28.933361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c567d72d-4b3c-44e9-8028-367d32f7a2e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083210 Oct 15 09:07:28.933948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 835/1611] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:29.956450 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:29.957137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:29.963482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:29.963964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:29.964396 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:29.965079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:29.965530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:29.965977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:30.029666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:30.038208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-800b1cd7-2eac-43f3-b47e-d95b1d8ec622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085629 Oct 15 09:07:30.038764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 836/1612] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:31.060491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:31.061191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:31.067497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:31.067993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:31.068409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:31.069092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:31.069543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:31.069989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:31.129621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:31.137744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f363ae97-6630-41eb-a139-8ddfd9dd1f5a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081223 Oct 15 09:07:31.138301 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 837/1613] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:32.161088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:32.162054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:32.168319 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:32.168796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:32.169230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:32.169943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:32.170398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:32.171417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:32.229979 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:32.238561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-adf06d0c-9b03-42db-94f6-2db873c96275 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081341 Oct 15 09:07:32.239115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 838/1614] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:33.141959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b165003f-d71d-4711-8b9f-5a999f7f81ec tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5f5280>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:42.166547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=7 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:42.234753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=42 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:45.721384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9d5f3c33-d484-4c69-a7d4-5e280b64ad31 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 72.642766 Oct 15 09:07:45.721993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 777/1615] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:06:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 72644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:07:45.727042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:45.727644 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:45.734276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:45.734798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:45.735232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:45.735919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:45.736370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:45.736789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:45.798370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:45.808041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4e80f5ac-2ca1-4842-b4f6-80f684e6c46f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085102 Oct 15 09:07:45.808601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 778/1616] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:07:45.885080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b165003f-d71d-4711-8b9f-5a999f7f81ec tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 12.747519 Oct 15 09:07:45.885672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 839/1617] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:07:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 12749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:07:45.945933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:45.946436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:45.952430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:45.953569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:45.953955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:45.954655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:45.955115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:45.955542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:45.987747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:07:46.028556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:46.029039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:46.035227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.035704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.036327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.037277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.037746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.038166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.052919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 HTTP/1.1 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:07:46.054698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '29f95b72-8aed-4cf1-9d99-e9a96e09e797'} Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:07:46.057562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.059045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.060555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:07:46.060555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-857e539e-624f-4617-b67f-f73f66efceab tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 404 len: 111 microversion: 2.20 time: 0.031437 Oct 15 09:07:46.060555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 840/1618] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Oct 15 09:07:46 2022] DELETE /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 15 09:07:46.065666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:46.066312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 29f95b72-8aed-4cf1-9d99-e9a96e09e797] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:46.073165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.073642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.074103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.074788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.075383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.075876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.090475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.090779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a23e9d2b-46e5-44f8-94f6-635817aa1101 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 204 len: 0 microversion: 2.1 time: 0.148295 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 HTTP/1.1 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:07:46.092137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.094534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '29f95b72-8aed-4cf1-9d99-e9a96e09e797'} Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:07:46.095374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. Oct 15 09:07:46.096731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:46.098098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 779/1619] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:07:45 2022] DELETE /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:07:46.098401 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 29f95b72-8aed-4cf1-9d99-e9a96e09e797 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:07:46.099317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef29d40a-9b20-444c-967b-05d52f3c1b2f tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797" status: 404 len: 111 microversion: 2.20 time: 0.038448 Oct 15 09:07:46.099865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 841/1620] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 09:07:46 2022] GET /compute/v2.1/servers/29f95b72-8aed-4cf1-9d99-e9a96e09e797 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 09:07:46.102785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:46.103496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:46.109526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.110043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.110481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.111189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.111626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.112107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.486809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:46.494486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5dfa59c0-468c-4d82-827c-3292666990cf tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1680 microversion: 2.1 time: 0.396421 Oct 15 09:07:46.495046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 780/1621] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:46 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:07:46.831555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:46.832200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:46.838539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.839017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.839446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.840128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:46.840584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:46.841005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:46.900347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f277ba90-c965-405b-9462-2a924fbd68d2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575accec10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:46.911244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:46.919788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8a26b507-7658-4cde-b2e0-63bcdbee88c7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.092046 Oct 15 09:07:46.920339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 842/1622] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:07:47.331271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82548603-b8ab-4ea8-8a18-eb7587a9f224", "name": "network-vif-deleted", "tag": "27000bb8-a32b-4e47-a8d0-6d7e704fc838"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:07:47.346554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.347032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.347489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:47.361536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] Creating event network-vif-deleted:27000bb8-a32b-4e47-a8d0-6d7e704fc838 for instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 on hv-cinder-85697 Oct 15 09:07:47.368269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-d34211b8-3fdf-4abc-bc69-e7883b49ade1 req-72883341-53cf-4b17-9ae6-8d98d2a99b04 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041726 Oct 15 09:07:47.369078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 843/1623] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:07:47.518143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:47.519067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:47.526584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.527419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.528101 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:47.529122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.529798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.530416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:47.572613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.573097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.573523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:47.573992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lazy-loading 'fault' on Instance uuid 82548603-b8ab-4ea8-8a18-eb7587a9f224 {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:07:47.618827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '060d1fae9b0b488da1f7553cabd97d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca38c1109acc49849daeb555b673e756', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:47.626524 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7dbaec5d-1216-4ad9-9bf6-8ad1f8a602c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 200 len: 1330 microversion: 2.1 time: 0.113360 Oct 15 09:07:47.627187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 844/1624] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:47 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:07:47.945129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:47.945968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:47.952600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.953158 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.953718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:47.955273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:47.955797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:47.956394 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:48.023424 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:48.032654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-742d8173-3048-4ef8-b22d-7b739218ca03 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.092428 Oct 15 09:07:48.033221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 845/1625] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:48.650369 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:48.650888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:48.656743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:48.657887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:48.658333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:48.659003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:48.659446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:48.659860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:48.673768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 HTTP/1.1 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:07:48.675342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:07:48.677132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '82548603-b8ab-4ea8-8a18-eb7587a9f224'} Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:07:48.678192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:07:48.679856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:07:48.681366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:07:48.681366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4a3cc3cf-24e3-42eb-9f3b-768747fb79c6 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 404 len: 111 microversion: 2.1 time: 0.030318 Oct 15 09:07:48.681366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 846/1626] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:48 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:07:48.684836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-058b748f-b004-410d-85b6-4f9fcd275f41 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '.version_select at 0x7f575acecee0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:48.707897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-058b748f-b004-410d-85b6-4f9fcd275f41 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165985739" status: 202 len: 0 microversion: 2.1 time: 0.026380 Oct 15 09:07:48.708430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 847/1627] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 09:07:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165985739 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 09:07:49.055782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:49.056688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:49.064550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:49.065034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:49.065470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:49.066219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:49.067287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:49.067729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:49.129199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:49.137377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c97403e9-1998-4166-88b7-d8022348bec0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085530 Oct 15 09:07:49.137943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 848/1628] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:50.161059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:50.162026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:50.168308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:50.168791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:50.169225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:50.169940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:50.170400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:50.170827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:50.379636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:50.387776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d62b676f-5c7e-461a-aa62-32cd3f6ceb40 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.230551 Oct 15 09:07:50.388333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 849/1629] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:51.411899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:51.412516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:51.418963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:51.419437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:51.419865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:51.420536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:51.420980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:51.421397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:51.483799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:51.491890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-60fed210-2545-49ee-9702-f052225b47d3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084783 Oct 15 09:07:51.492431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 850/1630] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:52.514351 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:52.515122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:52.522072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:52.522551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:52.522981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:52.523699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:52.524151 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:52.524577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:52.584857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:52.592951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-77e3e7a6-4591-4363-babd-a2261d20f933 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082560 Oct 15 09:07:52.593498 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 851/1631] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:53.616665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:53.617279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:53.623628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:53.624104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:53.624532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:53.625210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:53.626368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:53.626801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:53.685861 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:53.694615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b7b0b990-4ad9-4da8-bd6e-68eaba66655d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081874 Oct 15 09:07:53.695160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 852/1632] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:54.717113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:54.717779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:54.724634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:54.725117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:54.725552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:54.726302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:54.726756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:54.727181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:54.787723 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:54.795874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d95c9fa6-b77f-4b8e-afc0-9f7bf3015e68 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082795 Oct 15 09:07:54.796420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 853/1633] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:55.818917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:55.819544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:55.825943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:55.826421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:55.826850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:55.827531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:55.827983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:55.828404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:55.892885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:55.900956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2ba9cac-ba5a-4fc9-9031-daa12cc54fd1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085899 Oct 15 09:07:55.901511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 854/1634] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:56.107363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:56.491477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:07:56.923920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:56.924526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:56.931022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:56.931497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:56.931929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:56.932608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:56.933057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:56.933478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:56.994067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:57.002606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e259a227-77af-4b64-ba0f-45c6bedcc37a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082616 Oct 15 09:07:57.003157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 855/1635] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:58.026251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:58.026897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:58.033932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:58.034419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:58.034856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:58.035549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:58.036005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:58.036432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:58.096752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:58.104959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c6b4b35b-f746-4c39-b1a2-fe2071c8b4a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082629 Oct 15 09:07:58.105513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 856/1636] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:07:59.127946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:07:59.128631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:07:59.135001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:59.135480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:59.135911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:59.136596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:07:59.137047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:07:59.137469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:07:59.197249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:07:59.205999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2b6514dd-d33c-4301-9114-1231f617fe7a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082440 Oct 15 09:07:59.206555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 857/1637] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:07:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:00.228409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:00.229054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:00.236002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:00.236486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:00.236918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:00.237604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:00.238082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:00.238507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:00.301906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:00.310032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d2c84163-84ba-43c5-b9a7-d2e9d4ce7d32 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085475 Oct 15 09:08:00.310584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 858/1638] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:01.333766 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:01.334462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:01.340636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:01.341110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:01.341540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:01.342238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:01.342687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:01.343107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:01.402821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:01.406300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:01.411496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-210c707a-99b6-427f-89ab-853f97e38476 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081633 Oct 15 09:08:01.412310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 859/1639] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:02.433413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:02.434031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:02.441694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:02.442175 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:02.442596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:02.443269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:02.443711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:02.444124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:02.508128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:02.516222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9daef898-ba89-4cca-9a20-6321ef51e0a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086617 Oct 15 09:08:02.516777 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 860/1640] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:03.539367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:03.539977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:03.546612 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:03.547095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:03.547537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:03.548199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:03.548677 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:03.549099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:03.608545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:03.616706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-af12dee2-69af-4942-9c30-4ef772331c12 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081505 Oct 15 09:08:03.617260 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 861/1641] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:04.639841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:04.640501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:04.646843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:04.647326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:04.647757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:04.648437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:04.648890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:04.649313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:04.712615 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:04.721210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2d81a243-02b0-4e89-bfc8-288500c295ba tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085201 Oct 15 09:08:04.721791 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 862/1642] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:05.743683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:05.744285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:05.750874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:05.751355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:05.751789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:05.752470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:05.752922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:05.753344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:05.813808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:05.821888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-20d9a5d1-b06e-4f10-b8ec-924f9cfb0407 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082246 Oct 15 09:08:05.822694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 863/1643] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:06.844820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:06.845460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:06.851511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:06.851992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:06.852433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:06.853116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:06.853573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:06.854021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:06.913252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:06.921288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-606b8cb3-74d8-42c3-854f-1305d5468865 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080367 Oct 15 09:08:06.921882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 864/1644] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:07.943807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:07.944468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:07.950922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:07.951398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:07.951827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:07.952500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:07.952947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:07.953884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:08.012788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:08.021222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-abe17877-a147-4f80-84bd-b1e2084fcd6f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081265 Oct 15 09:08:08.021785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 865/1645] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:09.045027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:09.045734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:09.052678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:09.053160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:09.053600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:09.054320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:09.054781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:09.055208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:09.118621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:09.126911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-747af163-ab80-4698-aed9-ef172587b891 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085822 Oct 15 09:08:09.127474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 866/1646] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:10.149451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:10.150086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:10.156464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:10.156949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:10.157382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:10.158105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:10.158568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:10.158996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:10.220859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:10.229110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a7b2d4bf-a0de-44ec-8860-4152e1aed55b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083510 Oct 15 09:08:10.229659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 867/1647] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:11.252312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:11.252995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:11.259244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:11.259715 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:11.260141 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:11.260815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:11.261268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:11.261699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:11.321918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:11.330856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-94d8f2a6-79b5-458a-9007-9d9578304664 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083046 Oct 15 09:08:11.331411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 868/1648] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:12.353149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:12.353929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:12.356287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:12.362344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:12.362817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:12.363241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:12.364137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:12.364592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:12.365010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:12.427516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:12.435605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-22ccf6f5-1e38-4365-904d-ca29f10eeb6a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086274 Oct 15 09:08:12.436154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 869/1649] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:13.459269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:13.459889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:13.466253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:13.466731 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:13.467159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:13.467846 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:13.468294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:13.468712 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:13.531264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:13.539765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fb014fa5-0360-46e4-af88-9c45245e5a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084349 Oct 15 09:08:13.540327 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 870/1650] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:14.562160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:14.562858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:14.569848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:14.570325 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:14.570757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:14.571432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:14.571880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:14.572298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:14.632725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:14.640950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d6d5a998-c02b-4f82-a8df-3f2cae6b2f48 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082534 Oct 15 09:08:14.641504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 871/1651] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:14.911822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:08:14.912650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:08:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:08:14.914130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:08:14.914258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:08:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:08:15.663423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:15.663965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:15.670356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:15.670836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:15.671264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:15.671965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:15.672421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:15.672842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:15.732229 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:15.740230 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d9d015a8-9510-4cd3-88e7-e31d4e5f3ddd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080975 Oct 15 09:08:15.740785 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 872/1652] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:16.763130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:16.763801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:16.770531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:16.771006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:16.771432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:16.772107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:16.772555 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:16.772973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:16.832432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:16.840382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4d8c8456-b33b-4314-a1be-d536190ab8b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081086 Oct 15 09:08:16.840928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 873/1653] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:17.864238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:17.864858 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:17.871224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:17.871698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:17.872127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:17.872804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:17.873254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:17.873693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:17.939553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:17.947684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1493e456-aeb3-4df9-87f3-d5f84b6e0957 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087957 Oct 15 09:08:17.948276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 874/1654] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:18.970864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:18.971544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:18.978031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:18.978519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:18.978951 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:18.979636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:18.980088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:18.980509 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:19.043059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:19.051698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ffd0eaad-ef92-4c21-b206-189e7a6a7b1b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084794 Oct 15 09:08:19.052257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 875/1655] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:20.075159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:20.075833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:20.082822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:20.083302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:20.083734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:20.084415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:20.084869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:20.085291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:20.103130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:20.146683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:20.154860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-29000918-a47e-4261-80c1-68403addf18b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083588 Oct 15 09:08:20.155417 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 876/1656] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:21.178477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:21.179173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:21.185484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:21.185999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:21.186431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:21.187108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:21.188093 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:21.188508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:21.249085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:21.258473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d1f855a0-66a3-46aa-bc9e-133b9c90af8b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083853 Oct 15 09:08:21.259022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 877/1657] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:22.280387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:22.281064 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:22.288245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:22.288726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:22.289162 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:22.289880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:22.290339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:22.290767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:22.354010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:22.362249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7366e5a0-b14f-4d47-97fa-89c057fe40a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085730 Oct 15 09:08:22.362840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 878/1658] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:23.385529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:23.386238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:23.393223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:23.393724 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:23.394163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:23.394865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:23.395353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:23.395786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:23.456300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:23.464425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a2b6d15d-7aaa-4931-8d6e-ec6f1ab08b29 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082826 Oct 15 09:08:23.464981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 879/1659] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:24.487111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:24.487733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:24.494049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:24.494522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:24.494947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:24.495623 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:24.496068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:24.496483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:24.558897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:24.567522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fff2cc41-9eeb-414d-bba8-af6a2dd1c125 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084365 Oct 15 09:08:24.568070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 880/1660] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:25.590709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:25.591296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:25.598326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:25.598797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:25.599223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:25.599894 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:25.600367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:25.600780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:25.660273 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:25.668517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dd3c568c-53c7-4228-9d6b-11342f39f8f5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081689 Oct 15 09:08:25.669066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 881/1661] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:26.692357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:26.693036 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:26.699422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:26.699925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:26.700353 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:26.701062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:26.701506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:26.701953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:26.765263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:26.773438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-54f8df27-4783-4187-b56f-4d94f41db6b7 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085822 Oct 15 09:08:26.774028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 882/1662] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:27.795958 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:27.796608 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:27.803051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:27.803525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:27.803952 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:27.804626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:27.805071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:27.805489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:27.865114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:27.873090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-996bf62c-a90f-40de-ad85-e48e6cc5c6b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081045 Oct 15 09:08:27.873639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 883/1663] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:28.896549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:28.897265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:28.903630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:28.904117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:28.904545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:28.905228 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:28.905706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:28.906745 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:28.966874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:28.975032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a410b289-22c5-4e97-86f8-e30a08f2db08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082386 Oct 15 09:08:28.975582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 884/1664] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:29.997819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:29.998488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:30.005485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:30.006006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:30.006434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:30.007125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:30.007584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:30.008005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:30.069054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:30.077357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01803761-2bad-4872-a21e-92e8ef0719ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083502 Oct 15 09:08:30.078704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 885/1665] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:31.100603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:31.101322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:31.107539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:31.108018 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:31.108441 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:31.109184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:31.109637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:31.110079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:31.172722 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:31.180755 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-45f70a2a-0554-41fc-a63f-efc6a3b8cdb4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083982 Oct 15 09:08:31.181298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 886/1666] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:32.202926 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:32.203635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:32.209924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:32.210400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:32.210827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:32.211497 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:32.211940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:32.212354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:32.273774 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:32.282283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b8b3f815-0645-4b52-a7c2-1c1e5fe959e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083233 Oct 15 09:08:32.282834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 887/1667] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:32.952360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f277ba90-c965-405b-9462-2a924fbd68d2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 46.055834 Oct 15 09:08:32.953977 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 781/1668] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:07:46 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 46058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:08:33.305631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:33.306276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:33.312594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:33.313051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:33.313484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:33.314200 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:33.314652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:33.315073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:33.377024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:33.385400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-09d57acf-c1c1-446e-bf14-c0fd0690709d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083666 Oct 15 09:08:33.386012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 888/1669] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:08:33.967844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f8fd6e63-f016-417d-a223-51651da88d0b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575acce310>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:34.407867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:34.408480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:34.415220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:34.415699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:34.416136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:34.416823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:34.417282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:34.417735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:34.478012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:34.486639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5856b032-ebb7-4bd1-a797-627fa45acedf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083179 Oct 15 09:08:34.487201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 889/1670] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:35.509897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:35.510516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:35.516992 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:35.517470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:35.517937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:35.518630 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:35.519086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:35.519508 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:35.582844 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:35.591106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-97f52fe0-2a42-4f27-bb7b-2905da6c0f64 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085172 Oct 15 09:08:35.591666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 890/1671] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:36.613584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:36.614250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:36.620340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:36.620821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:36.621257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:36.621970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:36.622433 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:36.622853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:36.682251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:36.690610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e1593cc9-70fb-4017-95db-4107647b08d8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081516 Oct 15 09:08:36.691393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 891/1672] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:37.713516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:37.714165 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:37.720461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:37.720939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:37.721376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:37.722083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:37.722537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:37.722961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:37.782954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:37.791337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3c4d4196-f649-4592-a9ee-d7aad033f674 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081756 Oct 15 09:08:37.791898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 892/1673] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:38.814963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:38.815628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:38.821714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:38.822199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:38.822633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:38.823318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:38.823771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:38.824202 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:38.828708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:38.884267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:38.892938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e4b08cba-5da3-432a-afc5-e5ea1c03dcf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082299 Oct 15 09:08:38.893495 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 893/1674] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:39.915782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:39.916415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:39.923337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:39.923806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:39.924227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:39.924899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:39.925346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:39.925786 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:39.989807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:39.997950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-089c37c1-7d04-40d2-8b79-4cab72a7c607 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086372 Oct 15 09:08:39.998499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 894/1675] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:41.020665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:41.021338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:41.027770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:41.028261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:41.028699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:41.029389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:41.029880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:41.030317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:41.090556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:41.099332 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ebef6209-32d5-44c9-8eb7-3e4e89babc9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082654 Oct 15 09:08:41.099919 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 895/1676] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:42.122546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:42.123254 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:42.129535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:42.130040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:42.130469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:42.131145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:42.131593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:42.132008 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:42.191468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:42.199507 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d6bef054-9c1d-4833-89d8-caa50fa8a11e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080770 Oct 15 09:08:42.200055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 896/1677] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:43.224037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:43.224697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:43.226906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=56 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:43.232159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:43.232632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:43.233059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:43.234307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:43.234758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:43.235176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:43.294513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:43.303232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fff5a63e-012b-447e-b113-2862a00c16e2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083016 Oct 15 09:08:43.303907 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 897/1678] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:43 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:44.327333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:44.328643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:44.334963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:44.335446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:44.335879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:44.336567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:44.337020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:44.337443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:44.400708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:44.408900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d5c3e084-d6ca-4895-b7dd-dfe3bb1d1cc1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085456 Oct 15 09:08:44.409455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 898/1679] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:08:45.431773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:45.432384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:45.438801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:45.439279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:45.439711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:45.440390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:45.440841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:45.441261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:45.500818 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:45.508956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-41e7a0f0-b1af-4e94-be51-9e2540fd2477 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081093 Oct 15 09:08:45.509511 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 899/1680] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:46.532272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:46.532968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:46.539499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:46.539977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:46.540407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:46.541096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:46.541552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:46.542000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:46.603783 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:46.612476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c8e2c2fc-3ae1-4c9a-bd81-054964448462 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084612 Oct 15 09:08:46.613032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 900/1681] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:47.633927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:47.634540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:47.641324 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:47.641823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:47.642251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:47.642929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:47.643377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:47.643793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:47.703061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:47.711092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c6e2f024-765a-46a4-8425-015ef0656b77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081098 Oct 15 09:08:47.711642 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 901/1682] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:48.734298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:48.734931 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:48.741197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:48.741693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:48.742133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:48.742813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:48.743263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:48.743684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:48.806678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:48.815253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ca3df4fa-ae68-4a68-8d90-f456748a04e4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084957 Oct 15 09:08:48.815803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 902/1683] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:49.838522 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:49.839163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:49.846148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:49.846646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:49.847061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:49.847742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:49.848192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:49.848614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:49.909081 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:49.917467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-efd341e3-6961-4ee5-97db-06ab8dc9c973 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082818 Oct 15 09:08:49.918054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 903/1684] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:50.940956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:50.941625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:50.947977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:50.948454 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:50.948887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:50.949562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:50.950043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:50.950463 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:51.010015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:51.018697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-482d0427-b23d-42de-a1a5-7c349b814b5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082160 Oct 15 09:08:51.019249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 904/1685] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:52.041199 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:52.041915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:52.048356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:52.048832 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:52.049265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:52.049978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:52.050430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:52.050852 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:52.111146 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:52.119234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-346eca52-91b8-4a82-ac77-6a1820ee23d4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082184 Oct 15 09:08:52.119793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 905/1686] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:53.142080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:53.142666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:53.148877 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:53.149352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:53.149814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:53.150500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:53.150945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:53.151367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:53.215467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:53.224469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-860ec9e5-c303-4273-90d9-e5a4f72a9168 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086138 Oct 15 09:08:53.225053 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 906/1687] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:54.248596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:54.249887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:54.256152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:54.256663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:54.257098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:54.257812 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:54.258265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:54.258685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:54.321737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:54.329957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-158b8036-4267-47c4-b8e7-2b718079d6e6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085188 Oct 15 09:08:54.330512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 907/1688] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:55.351915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:55.352603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:55.358833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:55.359314 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:55.359743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:55.360426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:55.360878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:55.361304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:55.530983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:55.539477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3d75f4a2-814c-4001-a884-9d2b108b6c58 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.191481 Oct 15 09:08:55.540039 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 908/1689] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:56.563710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:56.564403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:56.570598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:56.571211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:56.571534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:56.572241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:56.572793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:56.573226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:56.634317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:56.637654 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:08:56.643225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3284eb0-09b2-49b4-ae00-cf69dad2823f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084949 Oct 15 09:08:56.643788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 909/1690] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:57.666266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:57.666924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:57.673828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:57.674311 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:57.674742 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:57.675432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:57.675882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:57.676308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:57.738469 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:57.746496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-280a8b49-fb60-40c2-acbd-be10e0625962 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084605 Oct 15 09:08:57.747052 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 910/1691] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:58.769978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:58.770638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:58.776860 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:58.777335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:58.777784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:58.778465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:58.778909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:58.779326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:58.838847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:58.847462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c1c63621-d7ff-4b95-bd89-13b581dee11c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081307 Oct 15 09:08:58.848020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 911/1692] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:08:59.869757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:08:59.870427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:08:59.877192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:59.877695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:59.878131 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:59.878817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:08:59.879276 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:08:59.879698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:08:59.939613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:08:59.947803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-77d86e25-2395-489f-8dc5-b2f435807628 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081907 Oct 15 09:08:59.948364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 912/1693] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:08:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:00.971047 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:00.971721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:00.978065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:00.978551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:00.978985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:00.979671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:00.980125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:00.980552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:01.042371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:01.050963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c08530ef-4416-484b-98d8-2d3d8906e041 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083809 Oct 15 09:09:01.051519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 913/1694] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:02.074477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:02.075140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:02.081445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:02.081956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:02.082398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:02.083061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:02.083530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:02.083949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:02.145886 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:02.153921 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6b92bc73-a188-4e4f-9fd9-893e9569d83e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083297 Oct 15 09:09:02.154477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 914/1695] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:03.177760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:03.178425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:03.184875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:03.185360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:03.185826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:03.186521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:03.186980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:03.187407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:03.247650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:03.256192 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-16b1d404-4a37-44f4-a430-77c2be1e5490 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082315 Oct 15 09:09:03.256780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 915/1696] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:04.281503 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:04.282240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:04.288661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:04.289133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:04.289568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:04.290281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:04.290727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:04.291140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:04.350803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:04.358983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c7f0b8d1-ab64-4bdb-8d7e-0060f45d8bfe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081920 Oct 15 09:09:04.359530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 916/1697] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:05.381721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:05.382407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:05.388739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:05.389215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:05.389696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:05.390383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:05.390834 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:05.391256 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:05.452465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:05.460568 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c72bc033-8b00-4a32-aa68-e2626a085ed2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082813 Oct 15 09:09:05.461129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 917/1698] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:06.483476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:06.484087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:06.490211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:06.490686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:06.491116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:06.491796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:06.492244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:06.492676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:06.556836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:06.565780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-acf6b210-a68c-4c73-8233-1307d8b8ea5d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086174 Oct 15 09:09:06.566335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 918/1699] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:07.588307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:07.588941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:07.595869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:07.596341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:07.596771 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:07.597446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:07.597922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:07.598344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:07.658110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:07.666493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cec32d4e-57cb-49e4-8b9c-a99ba9da1aa1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082036 Oct 15 09:09:07.667045 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 919/1700] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:08.689801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:08.690451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:08.696696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:08.697168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:08.697592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:08.698291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:08.698735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:08.699152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:08.761355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:08.769336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a5df5d6a-716e-4299-8287-35181ec3ff0f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083453 Oct 15 09:09:08.769920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 920/1701] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:09.792082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:09.792769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:09.799129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:09.799604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:09.800030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:09.800708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:09.801157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:09.801577 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:09.860496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:09.868525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ad73b0dd-ecd9-4845-ba0c-1f69f3244dad tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080553 Oct 15 09:09:09.869079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 921/1702] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:10.892361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:10.893058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:10.899400 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:10.899884 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:10.900318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:10.901003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:10.901458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:10.901916 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:10.965339 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:10.973537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-07258908-505f-4e82-9b23-ba640673ea17 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085566 Oct 15 09:09:10.974130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 922/1703] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:11.996130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:11.996784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:12.004020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:12.004499 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:12.004934 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:12.005617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:12.006103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:12.006527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:12.066293 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:12.074310 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-951c710c-2eaa-4729-a334-8f363a5ab22e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082021 Oct 15 09:09:12.074859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 923/1704] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:13.098123 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:13.098807 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:13.105174 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:13.105652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:13.106113 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:13.106796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:13.107247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:13.107669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:13.167624 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:13.176167 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eceba9f6-a0c6-45b1-bde3-89886a482c73 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081911 Oct 15 09:09:13.176721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 924/1705] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:14.199380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:14.200082 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:14.202297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=56 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:09:14.207458 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:14.207939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:14.208375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:14.209059 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:14.209514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:14.209963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:14.269295 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:14.277344 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0a221183-77b4-4c83-b4b2-97fb3ddfca9c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081917 Oct 15 09:09:14.277941 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 925/1706] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:15.301148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:15.301889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:15.308115 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:15.308598 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:15.309033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:15.309751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:15.310207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:15.310631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:15.329226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=100 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:09:15.374970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:15.383157 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-550ad872-fef8-4007-9491-55dd5439db1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085918 Oct 15 09:09:15.383711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 926/1707] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:16.406409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:16.407435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:16.414166 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:16.414641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:16.415071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:16.415753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:16.416203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:16.416625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:16.478591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:16.486714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5223433c-7c98-4800-a053-3e922344c1b8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084480 Oct 15 09:09:16.487275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 927/1708] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:17.510462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:17.511077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:17.517957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:17.518438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:17.518871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:17.519562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:17.520014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:17.520437 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:17.580294 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:17.588460 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ee13d4e3-289b-44ef-94bf-248200c1cbc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081830 Oct 15 09:09:17.589020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 928/1709] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:18.612251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:18.612899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:18.619177 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:18.619648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:18.620078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:18.620749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:18.621207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:18.621607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:18.681223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:18.689821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7c469520-4e83-4d94-a77a-d0236d2b86a4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081476 Oct 15 09:09:18.690375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 929/1710] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:19.712622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:19.713224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:19.719563 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:19.720044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:19.720478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:19.721164 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:19.721622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:19.722075 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:19.785288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:19.793696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eca6226e-c83a-4dc1-8e87-fe588f49e59e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085101 Oct 15 09:09:19.794268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 930/1711] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:20.817375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:20.818068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:20.824483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:20.824943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:20.825370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:20.826077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:20.826529 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:20.826946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:20.887496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:20.895730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b4ae5143-885a-4a78-9a32-ff17b6d779d2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082189 Oct 15 09:09:20.896288 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 931/1712] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:21.919521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:21.920163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:21.927057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:21.927530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:21.927956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:21.928655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:21.929103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:21.929515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:21.989013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:21.997002 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9637872e-4ecd-4931-aa58-2aacd3d00e09 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081335 Oct 15 09:09:21.997553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 932/1713] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:23.019631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:23.020299 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:23.026625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:23.027105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:23.027534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:23.028218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:23.028668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:23.029090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:23.092702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:23.100964 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b9179363-04a4-4f52-95c8-8cc8a2d6055e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085235 Oct 15 09:09:23.101551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 933/1714] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:24.124751 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:24.125411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:24.131790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:24.132265 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:24.132696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:24.133378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:24.133863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:24.134287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:24.196160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:24.204817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fbf24c2e-e59b-4c86-bae8-d599d6102eb3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084564 Oct 15 09:09:24.205376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 934/1715] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:25.227194 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:25.227835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:25.234062 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:25.234540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:25.234972 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:25.235678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:25.236130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:25.236552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:25.297031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:25.305152 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3914180b-582a-47c6-a4cc-a43539d779cc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081846 Oct 15 09:09:25.305733 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 935/1716] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:26.328274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:26.328987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:26.335283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:26.335762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:26.336196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:26.336874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:26.337326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:26.337772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:26.397660 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:26.406448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-62835bab-8fd5-4823-8196-36cc98ba10dc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082057 Oct 15 09:09:26.407005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 936/1717] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:27.429850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:27.430459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:27.437408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:27.437922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:27.438352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:27.439040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:27.439491 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:27.439917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:27.500135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:27.508274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4467d74a-bd8d-4468-84d3-c3adb600da00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082398 Oct 15 09:09:27.508826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 937/1718] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:28.531567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:28.532235 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:28.538788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:28.539268 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:28.539698 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:28.540379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:28.540830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:28.541252 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:28.605335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:28.614372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01e040e5-7c29-473a-a685-f7894540f992 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087281 Oct 15 09:09:28.614923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 938/1719] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:29.636020 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:29.636629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:29.643636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:29.644111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:29.644543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:29.645224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:29.645672 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:29.646120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:29.706929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:29.714942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9f792a78-6b8e-4911-ac14-612d252a6217 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082756 Oct 15 09:09:29.715504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 939/1720] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:30.737300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:30.737987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:30.744217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:30.744697 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:30.745133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:30.745850 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:30.746306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:30.746729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:30.808398 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:30.817103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cc4953a3-5993-4a31-bac4-2d2545e77e44 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083747 Oct 15 09:09:30.817655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 940/1721] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:31.840699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:31.841379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:31.848277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:31.848753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:31.849176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:31.849883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:31.850333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:31.850749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:31.910644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:31.918873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-563b0953-f69a-49a0-b235-53b23ec2b8df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082256 Oct 15 09:09:31.919418 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 941/1722] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:32.941244 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:32.941882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:32.948333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:32.948817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:32.949250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:32.949966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:32.950518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:32.950948 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:33.015557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:33.023673 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a1ba864e-16db-40ba-8846-420ab62a98a3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086298 Oct 15 09:09:33.024224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 942/1723] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:34.028357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-57637ae0-2319-4b60-b50d-a7fa7a95b8d6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae19d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:42.945664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=35 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:09:43.019361 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=98 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:09:46.319891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f8fd6e63-f016-417d-a223-51651da88d0b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 72.356369 Oct 15 09:09:46.320482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 782/1724] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:08:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 72358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:09:46.459470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:46.460080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:46.466687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:46.467200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:46.467631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:46.468318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:46.468772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:46.469194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:46.529620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:46.538728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7e882236-a2ec-463b-ad1c-5387c629757d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.217231 Oct 15 09:09:46.539303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 783/1725] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:09:46.619386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-57637ae0-2319-4b60-b50d-a7fa7a95b8d6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 12.594745 Oct 15 09:09:46.619949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 943/1726] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:09:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 12596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:09:47.575385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:47.575997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:47.582360 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:47.582832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:47.583259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:47.583941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:47.584389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:47.584806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:47.634106 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3158e498-098f-46de-844a-90001005f436 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e2dc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:47.644980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:47.653225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46aa296d-8dda-4976-aa9c-4b858929ec85 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081665 Oct 15 09:09:47.653741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 784/1727] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:09:48.676281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:48.676897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:48.683187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:48.683663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:48.684090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:48.684769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:48.685216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:48.685634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:48.745236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:48.753241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f9603ced-bc0b-45f8-9b0f-be1ec9b53bfb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080925 Oct 15 09:09:48.753821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 785/1728] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:49.775682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:49.776301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:49.783373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:49.783856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:49.784295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:49.784993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:49.785449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:49.785983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:49.850558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:49.858811 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-512af745-ef9c-490c-8400-09d83afa56e9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087046 Oct 15 09:09:49.859391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 786/1729] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:50.881448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:50.882128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:50.888471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:50.888979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:50.889410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:50.890134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:50.890592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:50.891024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:51.196930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:51.205194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-52aa0dc4-fa58-4197-9c37-b02f87563708 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.327673 Oct 15 09:09:51.205777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 787/1730] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:52.228034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:52.228718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:52.235529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:52.236001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:52.236429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:52.237104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:52.237554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:52.238003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:52.297228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:52.305156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-65e6063e-7d34-4909-a036-3898c906fad5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080985 Oct 15 09:09:52.305726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 788/1731] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:52.359333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:09:52.359823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:09:53.328357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:53.328968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:53.335375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:53.335857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:53.336286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:53.336964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:53.337414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:53.337866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:53.397543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:53.406607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d34a8822-f0c7-470a-b4d6-18cbf9227ce0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082090 Oct 15 09:09:53.407181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 789/1732] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:54.429270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:54.430031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:54.437093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:54.437565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:54.438025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:54.438702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:54.439149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:54.439566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:54.498986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:54.506974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-541a9100-16c0-414f-87df-99c597fc6e2d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081568 Oct 15 09:09:54.507535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 790/1733] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:55.528353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:55.528962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:55.536438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:55.536918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:55.537351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:55.538068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:55.538773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:55.539195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:55.601542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:55.610432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a9e2bb38-7623-4a8e-8c3f-e2a055865544 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085990 Oct 15 09:09:55.610997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 791/1734] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:56.632532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:56.633236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:56.640145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:56.640652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:56.641094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:56.641833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:56.642292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:56.642717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:56.707769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:56.716030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d62254cf-8195-4203-b714-2c05adfb4ec4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087366 Oct 15 09:09:56.716602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 792/1735] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:09:57.738928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:57.739585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:57.745921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:57.746399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:57.746827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:57.747513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:57.747959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:57.748902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:57.808486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:57.816930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-84575d1c-9af7-4b5f-8799-c9ffdb4e6772 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081882 Oct 15 09:09:57.817489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 793/1736] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:58.840077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:58.840736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:58.847027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:58.847501 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:58.847951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:58.848634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:58.849081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:58.849498 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:58.908728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:09:58.917001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a24676b7-a874-4f86-94c7-0df683020ccf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080749 Oct 15 09:09:58.917564 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 794/1737] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:09:59.940347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:09:59.941023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:09:59.947513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:59.947997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:59.948429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:09:59.949117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:09:59.949570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:09:59.950024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:00.012645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:00.022294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a05f9f90-7ca3-4729-b09e-e3049006487a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085773 Oct 15 09:10:00.022875 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 795/1738] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:09:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:01.045650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:01.046356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:01.052702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:01.053182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:01.053617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:01.054338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:01.054780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:01.055200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:01.114209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:01.122271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-776638fc-c9da-48c5-a276-f749ff5ee46c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081033 Oct 15 09:10:01.122839 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 796/1739] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:02.145611 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:02.146350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:02.152616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:02.153091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:02.153521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:02.154253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:02.154706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:02.155124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:02.214876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:02.222974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-003be0ec-edbc-42e9-903f-53d2f0a9467e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081200 Oct 15 09:10:02.223529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 797/1740] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:03.244733 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:03.245363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:03.252416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:03.252896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:03.253327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:03.254036 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:03.254487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:03.254909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:03.317837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:03.325931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4c1c1a5b-c72a-4d0e-b3e7-577f08335b4b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084991 Oct 15 09:10:03.326578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 798/1741] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:04.348817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:04.349533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:04.355982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:04.356469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:04.356903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:04.358246 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:04.358703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:04.359125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:04.376559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:04.422937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:04.431248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-44a7997d-21bc-4d38-9e5c-0f6eddb0036a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086299 Oct 15 09:10:04.431815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 799/1742] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:05.453724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:05.454329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:05.460962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:05.461435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:05.461899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:05.462586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:05.463033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:05.463450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:05.523196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:05.531306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-165e339c-05fd-4e62-97e1-71ea05914a04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081510 Oct 15 09:10:05.531872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 800/1743] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:06.554425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:06.555095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:06.562862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:06.563389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:06.563913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:06.564688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:06.565230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:06.565612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:06.631440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:06.640227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2da2361c-6da7-4ae5-ad27-071b89de2fa3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.089660 Oct 15 09:10:06.640798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 801/1744] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:07.662914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:07.663738 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:07.670641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:07.671157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:07.671589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:07.672281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:07.672756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:07.673180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:07.732597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:07.740686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1859f96b-8867-4e3f-8042-92f9ff8655c4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081765 Oct 15 09:10:07.741253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 802/1745] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:08.763028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:08.764192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:08.770579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:08.771052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:08.771479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:08.772156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:08.772604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:08.773022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:08.836089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:08.844073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e2eb30b1-39e4-46dc-bff1-c004174218a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084943 Oct 15 09:10:08.844627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 803/1746] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:09.866107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:09.866708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:09.873183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:09.873660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:09.874122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:09.874803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:09.875259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:09.875679 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:09.937408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:09.945462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94fafe7d-a9cd-4d3b-844d-fcda4c17291c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083278 Oct 15 09:10:09.946057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 804/1747] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:10.968435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:10.969091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:10.975508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:10.975991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:10.976430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:10.977126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:10.977584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:10.978043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:11.040088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:11.048723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8c52765e-afa8-438f-af4b-9ef77a80f922 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084199 Oct 15 09:10:11.049286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 805/1748] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:12.072366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:12.073051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:12.080020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:12.080500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:12.080931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:12.081617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:12.082096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:12.082518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:12.142599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:12.150718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7ce42b93-dd90-4a30-8f8d-323da40ed4fc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082251 Oct 15 09:10:12.151281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 806/1749] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:13.172933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:13.173621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:13.179993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:13.180472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:13.180906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:13.181597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:13.182075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:13.182503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:13.246511 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:13.254722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b1335168-67c1-4a31-b7c8-f021f33883ec tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085685 Oct 15 09:10:13.255289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 807/1750] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:14.278405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:14.279112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:14.285519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:14.286035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:14.286474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:14.287166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:14.287620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:14.288045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:14.348088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:14.356302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ec522bcb-7b4d-49d9-aa37-fa6fb65d5524 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081745 Oct 15 09:10:14.356871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 808/1751] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:15.378917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:15.379625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:15.386028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:15.386515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:15.386945 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:15.387639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:15.388091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:15.389019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:15.448993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:15.457609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6548c97d-e7db-4076-82d6-85ce19e4df08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082587 Oct 15 09:10:15.458199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 809/1752] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:16.480306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:16.480907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:16.483256 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=55 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:16.488717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:16.489464 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:16.489925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:16.490607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:16.491055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:16.491472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:16.551391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:16.559463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-92ac52a4-5362-4082-84bc-2e41a5f5cd56 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082996 Oct 15 09:10:16.560021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 810/1753] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:17.582867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:17.583507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:17.589934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:17.590414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:17.590849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:17.592172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:17.592632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:17.593056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:17.657853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:17.666251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-883f74f4-4985-4346-adc0-3b66c9f91e7e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087278 Oct 15 09:10:17.666816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 811/1754] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:18.688542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:18.689187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:18.695486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:18.695960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:18.696385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:18.697059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:18.697504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:18.697946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:18.757200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:18.765308 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3c850f6b-d37d-4648-b637-d953fe7aca9a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080673 Oct 15 09:10:18.765899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 812/1755] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:19.788335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:19.789223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:19.795637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:19.796117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:19.796531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:19.797201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:19.797645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:19.798087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:19.858282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:19.866388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8724cacb-3caf-46bf-9c8d-73764401aacd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081933 Oct 15 09:10:19.866950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 813/1756] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:20.887941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:20.888601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:20.894970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:20.895442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:20.895869 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:20.896545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:20.896991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:20.897406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:20.957091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:20.965215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-be7cad8c-aaae-43e5-ae03-87e056d5e6da tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081099 Oct 15 09:10:20.965797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 814/1757] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:21.987857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:21.988502 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:21.994916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:21.995398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:21.995833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:21.996520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:21.996974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:21.997395 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:22.059678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:22.067844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d200823f-68fe-4498-a4f5-a07780d9b0a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083847 Oct 15 09:10:22.068405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 815/1758] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:23.090717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:23.091902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:23.098489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:23.098970 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:23.099404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:23.100085 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:23.100547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:23.100969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:23.104844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:23.161262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:23.170335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3fc70961-6f8f-480a-adf6-e2715894fdac tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082787 Oct 15 09:10:23.170910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 816/1759] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:24.192431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:24.193136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:24.199517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:24.200003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:24.200446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:24.201638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:24.202121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:24.202548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:24.265403 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:24.273723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-49752175-ad47-4d1f-9fc6-d8a4822a55de tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085179 Oct 15 09:10:24.274299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 817/1760] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:25.298282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:25.298919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:25.305380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:25.305896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:25.306331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:25.307017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:25.307468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:25.307891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:25.370132 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:25.378451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d35686ce-7bd2-44e8-8886-cfd10593e16c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084611 Oct 15 09:10:25.379015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 818/1761] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:26.401030 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:26.401694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:26.408177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:26.408649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:26.409074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:26.409781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:26.410229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:26.410645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:26.473280 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:26.481309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1fb6300d-d7ad-43d0-b9b4-dddbc217449b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084280 Oct 15 09:10:26.482410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 819/1762] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:27.504499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:27.505186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:27.511600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:27.512081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:27.512517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:27.513743 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:27.514203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:27.514622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:27.574966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:27.583615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-851bb3e9-c4fb-4bed-81a7-8ce1cfdafe9e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Oct 15 09:10:27.584185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 820/1763] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:28.606460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:28.607729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:28.614229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:28.614715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:28.615149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:28.615846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:28.616295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:28.616720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:28.677104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:28.685262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d82745fe-ab47-4f88-a7ea-6daeffd0727e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082681 Oct 15 09:10:28.685883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 821/1764] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:29.708662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:29.709229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:29.715605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:29.716096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:29.716525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:29.717200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:29.717645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:29.718090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:29.777530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:29.785534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a6e48daf-125c-4024-8308-64054969058b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080840 Oct 15 09:10:29.786200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 822/1765] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:30.809762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:30.810420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:30.816824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:30.817305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:30.817761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:30.818456 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:30.818909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:30.819337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:30.881369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:30.889452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4f3e1293-4a99-4a34-93d3-81207f046500 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083607 Oct 15 09:10:30.890054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 823/1766] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:31.912566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:31.913184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:31.919751 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:31.920224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:31.920651 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:31.921332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:31.921804 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:31.922224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:31.983857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:31.992263 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e7d2c525-b07d-4d32-be6c-b05fcd9efde2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083595 Oct 15 09:10:31.992844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 824/1767] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:33.015183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:33.015842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:33.022203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:33.022685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:33.023117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:33.023844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:33.024295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:33.024724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:33.086339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:33.095344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2563fd5d-beb9-4d8c-be9b-09aa135f50b3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084378 Oct 15 09:10:33.095918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 825/1768] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:33.283538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3158e498-098f-46de-844a-90001005f436 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 45.653680 Oct 15 09:10:33.284126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 944/1769] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:09:47 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 45655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:10:34.118745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:34.119389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:34.125918 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:34.126401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:34.126829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:34.127518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:34.127975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:34.128399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:34.188943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:34.197298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-09f91fe4-4694-41df-9e3a-d1970450c8c6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082426 Oct 15 09:10:34.197944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 826/1770] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:34 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:34.298525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6d7c0040-842e-4958-bd2b-1def36fdc822 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:35.220146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:35.220747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:35.227225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:35.227711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:35.228143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:35.228834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:35.229289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:35.229737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:35.292489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:35.301398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-28887e71-fd71-4a64-9bde-1d6f08a9630b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085639 Oct 15 09:10:35.302037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 827/1771] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:35 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:36.324165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:36.324842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:36.331892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:36.332375 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:36.332813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:36.333500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:36.333986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:36.334418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:36.394737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:36.403084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6b887774-5be4-4e6c-97b9-fea739a9e05e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082744 Oct 15 09:10:36.404318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 828/1772] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:36 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:37.426647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:37.427240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:37.433126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:37.433599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:37.434063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:37.435247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:37.435692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:37.436109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:37.494763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:37.503438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f23e100a-7c85-4b00-899d-be56fb195c1d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080804 Oct 15 09:10:37.504000 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 829/1773] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:37 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:38.526860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:38.527589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:38.534545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:38.535041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:38.535477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:38.536191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:38.536650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:38.537077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:38.603463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:38.612556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-34084ead-0c72-486b-9a6c-1d8977069d3c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.089676 Oct 15 09:10:38.613145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 830/1774] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:38 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:39.635578 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:39.636230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:39.642530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:39.643008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:39.643440 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:39.644123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:39.644576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:39.644998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:39.709809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:39.718449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-55e51105-a8d3-45c9-99d7-382e9858e963 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086698 Oct 15 09:10:39.719019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 831/1775] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:39 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:40.742004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:40.742653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:40.749486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:40.749985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:40.750420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:40.751092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:40.751542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:40.751959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:40.811443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:40.814773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:40.820057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-18bb9369-b944-428d-b3c0-7395843b6f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082382 Oct 15 09:10:40.820618 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 832/1776] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:40 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:41.843306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:41.843933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:41.850447 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:41.850905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:41.851331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:41.852006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:41.852722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:41.853143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:41.912627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:41.921549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-48f6fa3f-0481-4b7e-869e-58cf493cddd0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083024 Oct 15 09:10:41.922138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 833/1777] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:41 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:42.944050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:42.944717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:42.951081 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:42.951559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:42.951984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:42.952659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:42.953106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:42.953552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:43.012859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:43.020816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dc24ccea-377d-48b8-b85e-d9fa5794b0a6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080624 Oct 15 09:10:43.021373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 834/1778] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:42 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:44.043463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:44.044615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:44.051003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:44.051493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:44.051923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:44.052608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:44.053060 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:44.053480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:44.118109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:44.126434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-40cfe128-3200-427c-9d6a-ac009cbaada9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086842 Oct 15 09:10:44.127016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 835/1779] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:44 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:45.148745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:45.149453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:45.155984 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:45.156459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:45.156907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:45.157585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:45.158057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:45.158477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:45.219109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:45.227168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4fab3b59-0378-49c5-9022-45aa6f201dd8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082325 Oct 15 09:10:45.227724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 836/1780] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:45 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:46.250075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:46.250762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:46.257118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:46.257603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:46.258065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:46.258753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:46.259207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:46.259630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:46.320217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:46.329012 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-951d1cd2-ab71-4ac0-83d8-f35032be802f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082899 Oct 15 09:10:46.329577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 837/1781] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:47.351877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:47.352560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:47.354951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=56 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:47.360184 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:47.360666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:47.361103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:47.361821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:47.362317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:47.362728 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:47.425807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:47.434004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-357949b2-bdf7-4d8d-9eea-0d4493d0dda9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086013 Oct 15 09:10:47.435639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 838/1782] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:48.457328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:48.457974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:48.464357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:48.464834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:48.465264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:48.466103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:48.466556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:48.466976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:48.529345 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:48.537535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-261428d3-fc0d-4ad3-bcfa-a11c8a5bb1ca tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084026 Oct 15 09:10:48.538131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 839/1783] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:48 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:49.560898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:49.561552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:49.567968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:49.568448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:49.568882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:49.569566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:49.570048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:49.570470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:49.630756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:49.638925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3d99b57a-207d-4a28-b7dc-422f1a2fb78a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082475 Oct 15 09:10:49.639489 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 840/1784] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:50.662074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:50.662711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:50.669276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:50.669784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:50.670222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:50.670905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:50.671361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:50.671781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:50.731508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:50.739553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b93b8c80-767e-4f8e-826a-e8a71dd1a42c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081502 Oct 15 09:10:50.740125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 841/1785] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:51.762238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:51.762861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:51.764855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:10:51.765007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:10:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a (ip 10.222.0.30) !!! Oct 15 09:10:51.772842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:51.773350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:51.773830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:51.774515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:51.774965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:51.775384 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:51.835991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:51.844630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6f781cfd-6e88-4f2a-869f-143439d7946d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086261 Oct 15 09:10:51.845248 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 842/1786] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:52.002635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:10:52.003133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:10:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:10:52.867765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:52.868376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:52.875458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:52.875935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:52.876362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:52.877038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:52.877487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:52.877936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:52.939892 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:52.947914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1c46959d-8d3e-40b2-86e1-c9e0300b6426 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084025 Oct 15 09:10:52.948475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 843/1787] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:53.970962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:53.971657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:53.978027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:53.978503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:53.978932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:53.979607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:53.980058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:53.980482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:54.042545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:54.051330 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-11d0bf76-a5ff-44bb-9f91-4e028c2f9cff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084297 Oct 15 09:10:54.051895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 844/1788] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:55.072986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:55.073596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:55.080058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:55.080560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:55.080991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:55.081709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:55.082192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:55.082619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:55.143891 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:55.151967 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f4e7e45a-cdd9-4e6b-a4a4-9155ff4c9c99 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082888 Oct 15 09:10:55.152528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 845/1789] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:56.174748 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:56.175429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:56.181759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:56.182239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:56.182667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:56.183347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:56.183795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:56.184773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:56.244720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:56.253329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bd861bbc-86a2-423d-928c-22465be75c00 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082530 Oct 15 09:10:56.253928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 846/1790] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:57.276672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:57.277357 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:57.284428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:57.284904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:57.285342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:57.286042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:57.286492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:57.286908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:57.350819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:57.359104 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4088992d-b288-404c-a578-04557c692bbc tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086844 Oct 15 09:10:57.359674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 847/1791] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:58.382148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:58.382928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:58.389321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:58.389834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:58.390270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:58.390968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:58.391422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:58.391846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:58.452407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:58.460599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d11839c2-5aa6-4155-8937-e8594fb7cbcd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082820 Oct 15 09:10:58.461468 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 848/1792] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:58 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:10:59.483933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:10:59.484543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:10:59.491047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:59.491532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:59.491966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:59.492658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:10:59.493111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:10:59.493537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:10:59.510872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:10:59.554362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:10:59.562455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1af99652-300a-48d0-87b9-10e98276a165 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082466 Oct 15 09:10:59.563022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 849/1793] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:10:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:11:00.584908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:00.585586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:00.592429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:00.592904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:00.593327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:00.594032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:00.594475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:00.594890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:00.655626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:00.664454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-93a7284d-850c-40c4-936a-1d31ae7d6c51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083169 Oct 15 09:11:00.665033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 850/1794] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:01.688407 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:01.689065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:01.695552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:01.696065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:01.696531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:01.697223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:01.697696 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:01.698136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:01.762276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:01.770453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e542ed2-0848-43c3-9be7-7fd121e9f027 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086657 Oct 15 09:11:01.771027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 851/1795] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:02.793162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:02.793834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:02.800247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:02.800718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:02.801148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:02.801859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:02.802307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:02.802724 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:02.862436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:02.870444 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b1ec597f-3e2d-473e-b627-91a58e7419b4 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081370 Oct 15 09:11:02.871006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 852/1796] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:03.893130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:03.893789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:03.900180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:03.900657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:03.901083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:03.901782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:03.902235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:03.902652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:03.962780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:03.971635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2cef9af7-42be-43d5-98b3-174281964672 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082327 Oct 15 09:11:03.972195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 853/1797] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:04.995607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:04.996230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:05.004038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:05.004523 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:05.004960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:05.005657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:05.006140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:05.006571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:05.067141 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:05.075305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e0c16e6f-3cf4-46a2-84c9-badd9db26692 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083614 Oct 15 09:11:05.075882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 854/1798] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:06.098223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:06.098904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:06.105159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:06.105634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:06.106162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:06.107471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:06.107919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:06.108337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:06.171373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:06.179495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c65488c8-3d32-45a9-b9b5-5b832b7f4390 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085192 Oct 15 09:11:06.180054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 855/1799] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:07.202103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:07.202817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:07.208685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:07.209167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:07.209604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:07.210313 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:07.210769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:07.211200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:07.270793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:07.279516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a96b8cb9-be66-4626-91b1-6cf808f5b645 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081309 Oct 15 09:11:07.280078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 856/1800] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:08.302405 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:08.303105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:08.309519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:08.310149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:08.310581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:08.311272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:08.311725 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:08.312149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:08.374335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:08.382627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-77de6126-ec5b-4a1a-b0a8-b9dfc8aca915 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084047 Oct 15 09:11:08.383203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 857/1801] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:09.404506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:09.405121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:09.411604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:09.412084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:09.412518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:09.413204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:09.413658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:09.414371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:09.475976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:09.484509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5694b9a3-1b78-44b5-9aa2-15dd6f00d70b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083970 Oct 15 09:11:09.485074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 858/1802] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:09 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:10.506936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:10.507544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:10.514513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:10.514988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:10.515417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:10.516096 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:10.516541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:10.516959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:10.579670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:10.587783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-beec0b67-9a68-4eac-9907-18ca6da4fa08 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084715 Oct 15 09:11:10.588338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 859/1803] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:11:11.610915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:11.611551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:11.617893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:11.618378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:11.618819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:11.619514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:11.619974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:11.620402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:11.681209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:11.690127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9ead5fd4-ec48-4c01-9028-950c66961a7d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083709 Oct 15 09:11:11.690694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 860/1804] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:12.712957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:12.713609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:12.719965 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:12.720448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:12.720885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:12.721573 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:12.722058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:12.722482 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:12.782408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:12.790761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a6e0b669-7152-49f3-9cb6-ab071345036d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081831 Oct 15 09:11:12.791356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 861/1805] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:13.813492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:13.814168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:13.820533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:13.821008 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:13.821434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:13.822137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:13.822588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:13.823005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:13.882452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:13.891064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cbd1bceb-3e36-4e5d-bc15-081b500a0381 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081444 Oct 15 09:11:13.891619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 862/1806] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:14.913500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:14.914436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:14.921322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:14.921827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:14.922300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:14.923056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:14.923535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:14.923957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:14.989108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:14.997439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c0e6ea40-4721-4b29-8a95-b960e3c425ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087734 Oct 15 09:11:14.998035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 863/1807] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:16.020092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:16.020744 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:16.027101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:16.027588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:16.028023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:16.029376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:16.029870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:16.030299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:16.092946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:16.101130 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cfd8867f-5929-45c1-ab6b-cff3d328bd05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084991 Oct 15 09:11:16.101711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 864/1808] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:17.124180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:17.124856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:17.131195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:17.131678 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:17.132110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:17.132793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:17.133244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:17.133667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:17.193237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:17.202656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9179fafe-ba32-4128-8151-679709ff164e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082913 Oct 15 09:11:17.203228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 865/1809] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:18.225415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:18.226127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:18.228340 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=56 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:18.234200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:18.234689 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:18.235124 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:18.235826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:18.236283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:18.236708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:18.240863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:18.297848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:18.306149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7fc27a95-48c3-4ace-8b3f-ee77a52c841c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084655 Oct 15 09:11:18.306720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 866/1810] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:19.329213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:19.329952 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:19.336467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:19.336959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:19.337399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:19.338123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:19.338582 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:19.339009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:19.402121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:19.410338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-31353344-db2e-4019-9726-e6014d2ade77 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085670 Oct 15 09:11:19.410899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 867/1811] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:20.432648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:20.433247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:20.440314 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:20.440784 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:20.441213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:20.441923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:20.442373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:20.442792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:20.502717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:20.510825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2a373253-3ac2-415d-bc76-c57a7534efed tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082035 Oct 15 09:11:20.511389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 868/1812] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:20 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:21.534553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:21.535194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:21.541853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:21.542332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:21.542758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:21.543439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:21.543887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:21.544938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:21.603882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:21.612680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7eaa2d4a-5692-482a-bd3b-367dc2d2c92a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081989 Oct 15 09:11:21.613240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 869/1813] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:22.635522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:22.636228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:22.643092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:22.643568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:22.643995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:22.644672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:22.645120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:22.645534 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:22.705549 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:22.713512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a4094812-2fbb-420b-bcee-ed5077d2f2db tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081864 Oct 15 09:11:22.714101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 870/1814] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:23.737524 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:23.738139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:23.744448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:23.744917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:23.745346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:23.746053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:23.746499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:23.746944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:23.811741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:23.819759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ac20e309-9565-470d-85ee-e127977b4dff tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086166 Oct 15 09:11:23.820316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 871/1815] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:24.844298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:24.844969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:24.851387 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:24.851871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:24.852305 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:24.852994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:24.853452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:24.853915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:24.915092 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:24.923212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ea6a0da5-0971-44c0-8394-0f2dbf0addf6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083336 Oct 15 09:11:24.923783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 872/1816] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:25.945775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:25.946429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:25.953379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:25.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:25.954328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:25.955016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:25.955471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:25.955896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:26.016072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:26.024164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6b217df4-5cff-4382-b9ad-1412c3106160 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082339 Oct 15 09:11:26.024729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 873/1817] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:27.047538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:27.048139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:27.054529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:27.055007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:27.055437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:27.056118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:27.056567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:27.056986 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:27.116620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:27.125185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-187ef3e7-b070-4513-b7e0-362cf01d5228 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081566 Oct 15 09:11:27.125760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 874/1818] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:28.148290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:28.148978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:28.155284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:28.155760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:28.156187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:28.156894 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:28.157342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:28.157795 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:28.220745 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:28.229003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5ec72199-b637-4a49-9293-10823aa870d6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084586 Oct 15 09:11:28.229570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 875/1819] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:29.252446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:29.253162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:29.259544 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:29.260028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:29.260463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:29.261146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:29.261601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:29.262057 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:29.321943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:29.330676 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-20db1584-8ec5-439f-93e4-32037c0561e0 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082092 Oct 15 09:11:29.331238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 876/1820] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:30.352363 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:30.353018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:30.359446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:30.359919 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:30.360346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:30.361029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:30.361474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:30.361956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:30.424639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:30.432719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-45e5325c-66c4-4c01-8cc1-e4162054aa34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084288 Oct 15 09:11:30.433276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 877/1821] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:31.456546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:31.457880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:31.464993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:31.465473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:31.465942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:31.466628 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:31.467082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:31.467503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:31.527198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:31.535339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b4b64c51-f6c0-4427-b278-b7b57b822f7f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082665 Oct 15 09:11:31.535895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 878/1822] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:31 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:32.558398 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:32.559051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:32.565353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:32.565876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:32.566304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:32.566982 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:32.567431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:32.567849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:32.631284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:32.639867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-59ee2563-5d3c-461e-a08c-1b783366441d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085303 Oct 15 09:11:32.640428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 879/1823] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:32 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:33.663083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:33.663642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:33.670936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:33.671415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:33.671856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:33.672541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:33.672994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:33.673415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:33.733211 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:33.741504 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cf41e3e4-6f89-46c0-991c-8277869935ce tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082427 Oct 15 09:11:33.742103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 880/1824] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:33 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:34.401641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1bade460-8f29-4e78-8413-b35cdb5cc7ba tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e1f70>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:35.535237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:11:35.535861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:11:35.536906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:11:35.537031 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:11:43.667911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=29 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:43.736901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=88 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:46.806179 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6d7c0040-842e-4958-bd2b-1def36fdc822 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 72.512090 Oct 15 09:11:46.806977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 945/1825] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:10:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 72514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:11:46.813110 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:46.813828 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:46.819864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:46.820350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:46.820778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:46.821467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:46.821944 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:46.822368 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:46.884356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:46.892428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-39fd25df-a4e9-4ae9-b2af-1000bf2c84e3 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084247 Oct 15 09:11:46.892987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 946/1826] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:46 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:11:47.085271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1bade460-8f29-4e78-8413-b35cdb5cc7ba tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 12.732958 Oct 15 09:11:47.085877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 881/1827] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:11:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 12734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:11:47.900381 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9eb9c-612a-4b42-8103-e2bb037d1f39", "name": "network-vif-deleted", "tag": "59c5c456-2eaf-42bc-8aef-e4159b0ecdb2"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:11:47.915917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:47.916539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:47.922060 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:47.922588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:47.923056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:47.930259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:47.931157 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:47.931927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:47.932636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:47.933089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:47.933526 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:47.948159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] Creating event network-vif-deleted:59c5c456-2eaf-42bc-8aef-e4159b0ecdb2 for instance 83c9eb9c-612a-4b42-8103-e2bb037d1f39 on hv-cinder-85697 Oct 15 09:11:47.959666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-ff6ecaa6-6ae2-4f70-a60a-c44428c1daee req-c7b035f4-bf86-493d-8d3d-87d186dc9d46 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210204 Oct 15 09:11:47.960274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 947/1828] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:11:48.000495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:48.009310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bdeb9197-1a67-487d-a47d-498101fd8c8f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.097564 Oct 15 09:11:48.009905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 882/1829] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:47 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:48.101628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5e9178dc-71d7-4ae2-b85a-b9972825228f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:49.031599 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:49.032209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:49.038629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:49.039111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:49.039541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:49.040485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:49.040934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:49.041356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:49.101270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:49.109887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-203a935f-7ac9-490b-8c1d-94924206dbe2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082191 Oct 15 09:11:49.110441 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 883/1830] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:49 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:50.132943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:50.133642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:50.140071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:50.140556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:50.140990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:50.141672 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:50.142152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:50.142572 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:50.204347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:50.212438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9ba65d07-6309-401f-9bf6-a6b185bc45ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083313 Oct 15 09:11:50.213007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 884/1831] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:50 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:51.235601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:51.236266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:51.242736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:51.243218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:51.243652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:51.244338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:51.244794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:51.245215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:51.305785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:51.313870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94ee0e1f-92fd-4e3c-9a64-76408ff1a622 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082119 Oct 15 09:11:51.314442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 885/1832] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:51 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:52.336872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:52.337561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:52.344473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:52.344956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:52.345392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:52.346123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:52.346583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:52.347011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:52.410617 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:52.419829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9a0af23b-f803-446f-8b65-0b7b7e17f9fd tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086829 Oct 15 09:11:52.420409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 886/1833] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:52 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:53.442265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:53.442903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:53.449267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:53.450279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:53.450710 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:53.451386 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:53.451833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:53.452251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:53.514051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:53.522518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-48733783-203d-4d01-981a-183730999725 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084148 Oct 15 09:11:53.523073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 887/1834] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:53 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:54.600624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:54.601268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:54.608660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:54.609406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:54.609877 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:54.610568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:54.611022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:54.611445 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:54.671257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:54.679368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-27d022f9-d8a3-4593-9e46-3f21273308fe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082896 Oct 15 09:11:54.679933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 888/1835] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:54 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:11:55.702818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:55.703718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:55.710166 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:55.710646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:55.711079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:55.711764 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:55.712218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:55.712642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:55.772089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:55.780289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ba33cb23-b541-466c-87b6-47948c4f1324 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081350 Oct 15 09:11:55.780859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 889/1836] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:55 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:56.804014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:56.804698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:56.811581 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:56.812062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:56.812497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:56.813181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:56.813634 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:56.814342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:56.878774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:56.886911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6c2f00e2-d3b0-4ad4-a8c9-395a341cef60 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086785 Oct 15 09:11:56.888129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 890/1837] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:56 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:57.908385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:57.910307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:57.911053 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:57.917697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:57.918183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:57.918615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:57.919304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:57.919755 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:57.920177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:57.928284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=8 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:11:57.980953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:57.989093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9d2c393d-2900-494d-bab5-87d6757c4d04 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082926 Oct 15 09:11:57.989649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 891/1838] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:57 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:11:59.011371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:11:59.012017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:11:59.018681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:59.019168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:59.019602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:59.020294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:11:59.020750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:11:59.021175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:11:59.081348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:11:59.089453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7d9cfa83-bebe-48dc-a8cf-bbbf4808f16a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081953 Oct 15 09:11:59.090046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 892/1839] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:11:59 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:00.113286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:00.113843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:00.121380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:00.121961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:00.122631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:00.123347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:00.123807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:00.124241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:00.185270 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:00.193449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94b8d1c0-5bbd-406b-b841-f4a9fe762bfa tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084236 Oct 15 09:12:00.194054 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 893/1840] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:00 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:01.216922 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:01.217627 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:01.223991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:01.224474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:01.224908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:01.225596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:01.226078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:01.226503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:01.289224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:01.297713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1161590a-9208-4f52-980c-c000a4d01924 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.085195 Oct 15 09:12:01.298286 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 894/1841] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:01 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:02.333927 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:02.334616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:02.341436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:02.341943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:02.342379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:02.343064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:02.343517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:02.343940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:02.404425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:02.412632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-12a6aecb-e996-4b32-880a-1dfe819ee763 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082613 Oct 15 09:12:02.413192 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 895/1842] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:02 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:03.434592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:03.435183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:03.441637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:03.442142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:03.442574 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:03.443249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:03.443697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:03.444112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:03.503551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:03.511558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5726f076-7d8b-45fa-a095-7155e9702296 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080888 Oct 15 09:12:03.512638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 896/1843] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:03 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:04.534780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:04.535414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:04.542164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:04.542643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:04.543076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:04.544361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:04.544819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:04.545240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:04.606541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:04.614640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1c7466af-a71b-487a-8cef-aa6d8a283ac6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083731 Oct 15 09:12:04.615207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 897/1844] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:04 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:05.637603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:05.638277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:05.644622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:05.645100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:05.645530 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:05.646245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:05.646697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:05.647120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:05.666173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:05.711740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:05.720605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-00d6f78d-1c0d-4d32-a889-a169243646f6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087407 Oct 15 09:12:05.721179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 898/1845] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:05 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:06.743465 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:06.744118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:06.750953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:06.751426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:06.751853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:06.752531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:06.752976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:06.753390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:06.813562 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:06.821648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-80ec40c6-99d6-4d66-aeef-00bf476cc88f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082079 Oct 15 09:12:06.822238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 899/1846] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:06 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:12:07.845379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:07.846049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:07.852222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:07.852698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:07.853127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:07.853844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:07.854300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:07.854721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:07.918111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:07.926428 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-22af930f-fc39-4274-a47f-16c89e00e70d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084871 Oct 15 09:12:07.926995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 900/1847] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:07 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:08.948843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:08.949540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:08.956078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:08.956567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:08.957004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:08.957709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:08.958170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:08.958591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:09.019100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:09.027219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7fed83c3-179d-4560-80e3-ffbfe1912a7c tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082249 Oct 15 09:12:09.028310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 901/1848] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:08 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:10.050075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:10.050836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:10.057022 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:10.057517 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:10.057976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:10.058657 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:10.059106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:10.059522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:10.121942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:10.130202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-42a89d97-0191-43d1-bdb4-96f5632e6de8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084004 Oct 15 09:12:10.130770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 902/1849] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:10 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:11.152349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:11.153541 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:11.159864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:11.160351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:11.160786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:11.161471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:11.161957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:11.162381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:11.221756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:11.229815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7ab4e944-f1a3-457b-b830-fae28dc7a4a5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081351 Oct 15 09:12:11.230380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 903/1850] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:11 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:12.252867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:12.253585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:12.260094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:12.260575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:12.261010 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:12.261709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:12.262667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:12.263089 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:12.325356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:12.333485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c2fcb20d-e54a-42f7-88a3-ca626f2a11df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084537 Oct 15 09:12:12.334088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 904/1851] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:12 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:13.357556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:13.358283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:13.364592 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:13.365063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:13.365486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:13.366194 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:13.366641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:13.367056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:13.427810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:13.436063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8ec0aa78-04e5-43cd-96e3-b4c10f82151b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.083030 Oct 15 09:12:13.436633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 905/1852] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:13 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:14.458293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:14.458917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:14.461177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=49 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:14.466451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:14.466934 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:14.467362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:14.468050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:14.468503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:14.468928 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:14.533933 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:14.542401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1de0b10a-1c09-48b6-aa81-5f69a4d8b9a2 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087959 Oct 15 09:12:14.543481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 906/1853] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:14 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:15.565954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:15.566579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:15.572943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:15.573423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:15.573890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:15.575158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:15.575615 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:15.576043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:15.635328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:15.644034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-85b042f4-5712-42a0-88d1-946cd3264f14 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082077 Oct 15 09:12:15.644600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 907/1854] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:15 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:16.666883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:16.667528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:16.673863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:16.674346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:16.674778 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:16.675462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:16.675916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:16.676343 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:16.737027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:16.745113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a337c586-7e20-49d0-87e8-26718b35ee34 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082507 Oct 15 09:12:16.745697 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 908/1855] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:16 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:17.768681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:17.769306 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:17.775792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:17.776272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:17.776706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:17.778021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:17.778485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:17.778908 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:17.838609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:17.846601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ba7070fa-785b-48f6-badc-62325a34f144 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.081769 Oct 15 09:12:17.847164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 909/1856] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:17 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:18.869015 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:18.869726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:18.876303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:18.876780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:18.877206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:18.877923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:18.878380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:18.878797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:18.943466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:18.951995 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b4ee19ee-4f9c-405c-b56c-6012f05b3bf8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086826 Oct 15 09:12:18.952550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 910/1857] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:18 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:19.975244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:19.975862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:19.982671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:19.983161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:19.983579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:19.984260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:19.984714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:19.985135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:20.045404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:20.053488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2ce5116d-2aa0-4ebf-b618-f6a947353dc6 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082192 Oct 15 09:12:20.054090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 911/1858] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:21.075872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:21.076525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:21.082915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:21.083392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:21.083816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:21.084495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:21.084937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:21.085351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:21.145996 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:21.154746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ae2207e0-46b7-4287-9dba-0d3874a8f3b5 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082741 Oct 15 09:12:21.155315 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 912/1859] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:21 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:22.177509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:22.178203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:22.185262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:22.185776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:22.186212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:22.186911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:22.187367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:22.187792 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:22.248193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:22.256258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cdecd20c-af6d-4c75-88c4-ae157274c681 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082640 Oct 15 09:12:22.256829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 913/1860] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:22 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:23.278937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:23.279637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:23.286126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:23.286621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:23.287045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:23.287727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:23.288180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:23.288605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:23.351227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:23.361761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-36b29815-ea78-4bb2-8a28-2c9f82ef8837 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.087185 Oct 15 09:12:23.362328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 914/1861] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:23 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:24.384378 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:24.385064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:24.391485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:24.391969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:24.392401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:24.393094 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:24.393575 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:24.394027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:24.398083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:24.455038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:24.463331 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f8906295-baa7-4c08-b8f8-a76ab49f1ecf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082865 Oct 15 09:12:24.463901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 915/1862] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:24 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:25.486882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:25.487567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:25.493988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:25.494472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:25.494909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:25.495601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:25.496546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:25.496968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:25.561551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:25.569762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c02b7555-4540-4c66-ab09-367a15a8f348 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.086878 Oct 15 09:12:25.570327 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 916/1863] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:25 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:26.592152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:26.592838 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:26.599514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:26.600003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:26.600476 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:26.601173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:26.601631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:26.602147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:26.664106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:26.673147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5558260d-d198-44b8-b098-2f1519237518 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084934 Oct 15 09:12:26.673730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 917/1864] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:26 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:27.696097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:27.696721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:27.703731 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:27.704206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:27.704629 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:27.705304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:27.705790 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:27.706208 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:27.768587 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:27.776706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca03162b-d68b-41cd-8c37-268876d52b4d tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084501 Oct 15 09:12:27.777298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 918/1865] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:27 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:28.799528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:28.800167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:28.806495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:28.806969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:28.807397 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:28.808069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:28.808531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:28.808947 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:28.868431 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:28.876509 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8f7fd424-2a1c-4f95-9d0a-0d960f02b31b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.080916 Oct 15 09:12:28.877070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 919/1866] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:28 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:29.899607 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:29.900320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:29.907183 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:29.907663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:29.908097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:29.908783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:29.909239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:29.909664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:29.969822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:29.980207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-62a6a65e-a7f7-4235-8387-66ddd7934e05 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.084358 Oct 15 09:12:29.981406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 920/1867] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:29 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:31.003765 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:31.004438 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:31.010810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:31.011287 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:31.011699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:31.012377 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:31.012827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:31.013249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:31.074694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:31.082855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b0014c9d-0e86-418e-a95b-0ad6879fbd2b tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 200 len: 1368 microversion: 2.1 time: 0.082922 Oct 15 09:12:31.083427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 921/1868] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:30 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:31.105774 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f3fe86b0-f0a8-4811-814d-6ea56da703df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '.version_select at 0x7f575ac6bc10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:31.127342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f3fe86b0-f0a8-4811-814d-6ea56da703df tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502744667" status: 202 len: 0 microversion: 2.1 time: 0.025759 Oct 15 09:12:31.127910 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 922/1869] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 09:12:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502744667 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 09:12:32.143100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33923145-d3f2-4105-bd1f-4fded60d2bf1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: .version_select at 0x7f575ac6a430>, body: {"keypair": {"name": "tempest-keypair-359580653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBi3Z0mIHTB5p8miMBXjvHSY/ryN/f+D6J9WuUduWli6eFLgGD7z8Q5r32SxiV485VHUPJE+drZgQ0vbAqsyVgn8/4Y5m/ZpEmRuQ4Z7Vc2r87qAMIKSAYpGDiDTbjDmQ=="}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:12:32.160019 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-33923145-d3f2-4105-bd1f-4fded60d2bf1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for project becb9cd46453447a87846cf26561a190. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:12:32.163895 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-33923145-d3f2-4105-bd1f-4fded60d2bf1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for user a5d85f7efca040cc81253dfbf0de7c42 and project becb9cd46453447a87846cf26561a190. Resources: {'key_pairs'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:12:32.187073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-33923145-d3f2-4105-bd1f-4fded60d2bf1 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048779 Oct 15 09:12:32.187705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 923/1870] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 09:12:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:12:33.413531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1199007261", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e61cdcd-c5f4-41ef-bbf5-ce16b32429c6"}], "security_groups": [{"name": "tempest-securitygroup--367511217"}], "key_name": "tempest-keypair-359580653", "user_data": "}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:12:33.484676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5e9178dc-71d7-4ae2-b85a-b9972825228f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 45.387102 Oct 15 09:12:33.491648 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 948/1871] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:11:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 45395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:12:33.512116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-04d3e006-2319-4d33-9bb0-58bf87aef208 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:33.524680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] validate_networks() for [('4e61cdcd-c5f4-41ef-bbf5-ce16b32429c6', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:12:33.991324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:12:33.991746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:12:33.992216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:12:33.992624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:12:33.993034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:12:34.001785 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:34.002267 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:34.002701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:34.003421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:34.003878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:34.004295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:34.021082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for project becb9cd46453447a87846cf26561a190. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:12:34.025134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Getting quotas for user a5d85f7efca040cc81253dfbf0de7c42 and project becb9cd46453447a87846cf26561a190. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:12:34.036621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:12:34.038863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:12:34.085798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-61232517-9f91-4fe6-8fc6-9ac3b45da53a tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677023 Oct 15 09:12:34.086455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 924/1872] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:12:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 15 09:12:34.098045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-54eff65b-8499-47fc-8996-0bb48040ad71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:34.098688 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-54eff65b-8499-47fc-8996-0bb48040ad71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:34.151594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-54eff65b-8499-47fc-8996-0bb48040ad71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:34.159253 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-54eff65b-8499-47fc-8996-0bb48040ad71 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1237 microversion: 2.1 time: 0.064951 Oct 15 09:12:34.159833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 925/1873] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:34 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:35.182687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:35.183373 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:35.190005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:35.190757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:35.191399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:35.192355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:35.192994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:35.193591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:35.270645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:35.279853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ee61f06d-17a0-49dc-8637-55a71af274d9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1297 microversion: 2.1 time: 0.101360 Oct 15 09:12:35.280591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 926/1874] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:35 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:12:36.302931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:36.303598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:36.310139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:36.310622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:36.311055 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:36.311746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:36.312196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:36.312614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:36.513379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:36.521250 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3c57d3fb-b0f7-4283-9fa4-890fe0cd42a8 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.222074 Oct 15 09:12:36.522032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 927/1875] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:36 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:12:36.645510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0666ec-7c1a-4b8f-851c-757bd90c873a", "tag": "0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:12:36.655740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:36.656299 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:36.657443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:36.669143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] Creating event network-changed:0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f for instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a on hv-cinder-85697 Oct 15 09:12:36.675284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-29fa2633-e553-45ab-b395-de5fef79bebc req-9e1535ab-eb60-4399-930d-7563e43385b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033426 Oct 15 09:12:36.675886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 928/1876] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:12:37.545726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:37.546430 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:37.552593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:37.553078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:37.553513 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:37.554238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:37.554693 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:37.555119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:37.680223 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:37.688029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0636ac4d-31ea-4fa3-9913-050955ddb58e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.147892 Oct 15 09:12:37.688602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 929/1877] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:37 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:38.710886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:38.711520 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:38.717876 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:38.718355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:38.718783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:38.719457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:38.719905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:38.720325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:38.845028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:38.852503 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-adb1d943-b0e8-42fd-9f86-f70b9b32e793 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.145630 Oct 15 09:12:38.853075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 930/1878] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:38 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:39.875450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:39.876061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:39.882512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:39.882991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:39.883423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:39.884117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:39.884568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:39.884988 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:40.014487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:40.022075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c1b70547-3369-4cb3-92ea-9250a577e632 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.150453 Oct 15 09:12:40.022646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 931/1879] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:39 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:41.044555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:41.045217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:41.051686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:41.052171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:41.052606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:41.053300 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:41.053801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:41.054221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:41.181761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:41.190376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-622319e3-0f6e-4e80-b0cb-c960bf25d714 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.149825 Oct 15 09:12:41.191004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 932/1880] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:41 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:42.214187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:42.214857 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:42.221225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:42.221741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:42.222188 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:42.222884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:42.223346 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:42.223775 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:42.349449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:42.357658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-02d288cb-2065-4b13-b504-25bf14998385 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.147341 Oct 15 09:12:42.358251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 933/1881] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:42 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:42.992318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0666ec-7c1a-4b8f-851c-757bd90c873a", "name": "network-vif-plugged", "status": "completed", "tag": "0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:12:43.001763 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:43.002249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:43.002684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:43.014210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] Creating event network-vif-plugged:0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f for instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a on hv-cinder-85697 Oct 15 09:12:43.019171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-c2dcb667-f5c5-4250-99c0-9ff1f632b9ad req-dc789675-af11-4cbe-b0a1-798dd2599132 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146819 Oct 15 09:12:43.019750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 934/1882] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:12:43.381752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:43.382491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:43.389369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:43.389886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:43.390326 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:43.391024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:43.391481 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:43.391907 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:43.518787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:43.527186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-22fac4e2-8f77-4b3c-ad23-12811ee9f2ae tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1362 microversion: 2.1 time: 0.150103 Oct 15 09:12:43.527756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 935/1883] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:43 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:44.550173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:44.550827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:44.552844 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:44.553543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=12 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:44.554638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:44.561806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:44.562292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:44.562769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:44.563413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:44.563867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:44.564293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:44.693870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:12:44.697239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=100 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:12:44.702558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fc62d3f6-2590-418f-8c10-7e999c61eebe tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1548 microversion: 2.1 time: 0.156284 Oct 15 09:12:44.703123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 936/1884] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:12:44 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:12:44.723791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:12:44.724277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:12:44.729819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:44.730806 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:44.731240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:44.731923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:44.732379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:44.732808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:44.807070 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a7c993f3-7418-477e-8977-453d54689330 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086907 Oct 15 09:12:44.807663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 937/1885] 10.222.0.30 () {58 vars in 1275 bytes} [Sat Oct 15 09:12:44 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:12:45.706842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c0666ec-7c1a-4b8f-851c-757bd90c873a", "tag": "0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:12:45.716197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:12:45.716741 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:12:45.717265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:12:45.728353 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] Creating event network-changed:0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f for instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a on hv-cinder-85697 Oct 15 09:12:45.734233 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-11e856ad-bacb-4be7-affc-e0f6cbc389d2 req-5f54e024-5c7d-468f-b18d-50d75d1c6b69 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Oct 15 09:12:45.734845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 938/1886] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:13:05.755145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:13:05.755611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:13:12.367753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:13:12.368485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:13:18.121594 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:13:18.122296 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:13:18.124660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=5 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:13:18.125302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:13:18.132122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:13:18.132603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:13:18.133038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:13:18.133753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:13:18.134213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:13:18.134639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:13:18.159180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c8b5164d-5543-4dcb-9e80-9c86b9236647 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/ips" status: 200 len: 145 microversion: 2.1 time: 0.042115 Oct 15 09:13:18.159742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 939/1887] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 09:13:18 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:13:33.571122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b67da876-91f4-4899-b8b9-c86bba637b99 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e1b80>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:13:33.578491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:13:33.579218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:13:47.856879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-04d3e006-2319-4d33-9bb0-58bf87aef208 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-04d3e006-2319-4d33-9bb0-58bf87aef208 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Request method failure captured: Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 HTTP/1.1 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnf46EkEx9Sj56tTYWkvFPekcNyx-R14R2-kT0IsIZM5axs4Zn-QNPWP1cIxMKxgetqvgmCLov4iRIWLk1WXSEXquo4W9GWXRiwE6VNUo3_5kRBbgqy7sro_-i9giGXxOdsl23yNiw0RAjfesyth-T95LTUTfSw5R0qo2LowHMovICE Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 0ade5da44ad948fdb77558898be6bd38 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:13:47.859604 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ade5da44ad948fdb77558898be6bd38", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 0ade5da44ad948fdb77558898be6bd38 Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesGetTestJSON-1956440075-project Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 525f7c26e8e74e17bf07d5d62150ad56 Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesGetTestJSON-1956440075-project Oct 15 09:13:47.861478 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '0a92163c-0cde-4380-ad0b-8cfddeff9574'} Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 09:13:47.862650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 09:13:47.864241 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.865892 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 138, in delete Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:13:47.867390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-04d3e006-2319-4d33-9bb0-58bf87aef208 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-95ee291e-11ea-4b02-93cc-b89b50bf0c75) {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-04d3e006-2319-4d33-9bb0-58bf87aef208 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 400 len: 397 microversion: 2.1 time: 74.352994 Oct 15 09:13:47.868881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 949/1888] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 09:12:33 2022] DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 397 bytes in 74354 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-b67da876-91f4-4899-b8b9-c86bba637b99 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b67da876-91f4-4899-b8b9-c86bba637b99 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Request method failure captured: Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 HTTP/1.1 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnf46EkEx9Sj56tTYWkvFPekcNyx-R14R2-kT0IsIZM5axs4Zn-QNPWP1cIxMKxgetqvgmCLov4iRIWLk1WXSEXquo4W9GWXRiwE6VNUo3_5kRBbgqy7sro_-i9giGXxOdsl23yNiw0RAjfesyth-T95LTUTfSw5R0qo2LowHMovICE Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: 0ade5da44ad948fdb77558898be6bd38 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:13:48.253074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0ade5da44ad948fdb77558898be6bd38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0ade5da44ad948fdb77558898be6bd38", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: 0ade5da44ad948fdb77558898be6bd38 Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-VolumesGetTestJSON-1956440075 Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-VolumesGetTestJSON-1956440075-project Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 525f7c26e8e74e17bf07d5d62150ad56 Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-VolumesGetTestJSON-1956440075-project Oct 15 09:13:48.256735 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '0a92163c-0cde-4380-ad0b-8cfddeff9574'} Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 09:13:48.257641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 15 09:13:48.258935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.260197 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 138, in delete Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:13:48.261427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b67da876-91f4-4899-b8b9-c86bba637b99 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots, awaiting a transfer, or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-e2d1582e-0c40-4095-97c4-c9dc4e6d0d05) {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b67da876-91f4-4899-b8b9-c86bba637b99 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 400 len: 397 microversion: 2.1 time: 14.668755 Oct 15 09:13:48.262783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 940/1889] 10.222.0.30 () {58 vars in 1248 bytes} [Sat Oct 15 09:13:33 2022] DELETE /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 397 bytes in 14670 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 15 09:13:48.263215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01ffd436-52a1-4376-8be0-6fef7caeebd6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af46c10>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:12.015127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:14:12.015685 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:14:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:14:33.833067 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01ffd436-52a1-4376-8be0-6fef7caeebd6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 45.591463 Oct 15 09:14:33.833835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 950/1890] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:13:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 45593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:14:33.886683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:33.887190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:14:33.893914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.894402 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.894843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.895540 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.895999 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.896427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.910434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df HTTP/1.1 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:14:33.912002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.913158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '5a4919f4-824b-4aec-8131-eabe4e8995df'} Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:14:33.914181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.915168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.916269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:14:33.916269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e57d3013-bde7-4c58-80a6-79a3ece139d7 tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 404 len: 111 microversion: 2.20 time: 0.032444 Oct 15 09:14:33.916269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 941/1891] 10.222.0.30 () {60 vars in 1280 bytes} [Sat Oct 15 09:14:33 2022] DELETE /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 15 09:14:33.924218 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:33.925316 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:14:33.929181 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:33.930035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] [instance: 5a4919f4-824b-4aec-8131-eabe4e8995df] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:14:33.931329 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.931825 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.932261 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.932960 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.933415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.934234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.938140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.938631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.939058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.939765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.940207 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.940625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.950571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 HTTP/1.1 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:14:33.952637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.953893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '82548603-b8ab-4ea8-8a18-eb7587a9f224'} Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:14:33.954529 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.955477 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.956404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:14:33.956404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f7470da6-2f61-44c6-a6cf-64be10b5715a tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 404 len: 111 microversion: 2.1 time: 0.034170 Oct 15 09:14:33.956404 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 942/1892] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:14:33 2022] DELETE /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:14:33.956949 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] HTTP exception thrown: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Request method failure captured: Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df HTTP/1.1 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL5syiiHZIOoKpeonhVEAELDJ_OzMhJbsGEiYSi0MUdEbQdEIPhs2CGmKUQLwG0MUMw7JhZRM73GEkcq7TkaA4Z1mSEmObrVQs0oFv9zIqwtESno7pPbVSBAMT9LGMAGP4vgr9iGpTBUUa31IUECx7uwVLRhUTRafbMW_QszXBOuHs Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Openstack-Nova-Api-Version: 2.20 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:14:33.958500 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/23e3a95b1487450cad043a820d321f26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/23e3a95b1487450cad043a820d321f26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_23e3a95b1487450cad043a820d321f26", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 23e3a95b1487450cad043a820d321f26 Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1552004018 Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 388ca829d87348bd9b524fd9a80e578b Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1552004018-project Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.959725 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '5a4919f4-824b-4aec-8131-eabe4e8995df'} Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:14:33.960432 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. Oct 15 09:14:33.961349 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.962206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] Returning 404 to user: Instance 5a4919f4-824b-4aec-8131-eabe4e8995df could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:14:33.962206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ca0e1e82-a97c-4760-9a77-ccb33e5e15ed tempest-AttachVolumeShelveTestJSON-1552004018 tempest-AttachVolumeShelveTestJSON-1552004018-project] 10.222.0.30 "GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df" status: 404 len: 111 microversion: 2.20 time: 0.034962 Oct 15 09:14:33.962206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 951/1893] 10.222.0.30 () {60 vars in 1277 bytes} [Sat Oct 15 09:14:33 2022] GET /compute/v2.1/servers/5a4919f4-824b-4aec-8131-eabe4e8995df => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 15 09:14:33.962368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:33.962948 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 82548603-b8ab-4ea8-8a18-eb7587a9f224] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:14:33.969507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.970020 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.970461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.971162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:14:33.971619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:14:33.972131 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:14:33.985848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 HTTP/1.1 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:14:33.987380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.988638 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '82548603-b8ab-4ea8-8a18-eb7587a9f224'} Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:14:33.989324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. Oct 15 09:14:33.990446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:14:33.991467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 82548603-b8ab-4ea8-8a18-eb7587a9f224 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:14:33.991467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f217bdf2-202f-4eb8-abcb-ce7e58df33bc tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224" status: 404 len: 111 microversion: 2.1 time: 0.030152 Oct 15 09:14:33.992391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 943/1894] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:14:33 2022] GET /compute/v2.1/servers/82548603-b8ab-4ea8-8a18-eb7587a9f224 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:14:34.847983 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fea41bb4-8410-4985-9766-9b1514f6c076 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5baee0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:14:43.934727 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:14:43.956691 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:15:34.902950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:15:34.903684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:15:34.904454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:15:34.904596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:15:34.906140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:15:34.906274 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:15:34.910605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0cde7360-77e4-4506-9b46-6c7beaca5e33 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:15:48.744954 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fea41bb4-8410-4985-9766-9b1514f6c076 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 73.900749 Oct 15 09:15:48.745538 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 952/1895] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:14:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 73902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:15:49.060717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0cde7360-77e4-4506-9b46-6c7beaca5e33 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 14.159320 Oct 15 09:15:49.061843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 944/1896] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:15:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 14161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:15:50.076073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-613ba452-9b90-4654-9c89-9eb487c9fa40 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad8a0d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:25.765513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:16:25.766159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:16:32.377601 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:16:32.378225 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:16:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:16:34.544420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-613ba452-9b90-4654-9c89-9eb487c9fa40 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 44.472855 Oct 15 09:16:34.549026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 953/1897] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:15:50 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 44474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:35.556153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:16:35.556643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:16:35.562601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0928ea6d-19ee-43cd-856d-18adb885b7ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0c8b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:35.627190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0928ea6d-19ee-43cd-856d-18adb885b7ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.072973 Oct 15 09:16:35.627770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 945/1898] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:35 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:36.640841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ae294c1-ce3e-467a-a1aa-e52dbd3726ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2be50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:36.686622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1ae294c1-ce3e-467a-a1aa-e52dbd3726ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050015 Oct 15 09:16:36.687247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 954/1899] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:36 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:37.701115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-70e10b32-0af0-474c-9093-02db19628b4a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62af0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:37.747243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-70e10b32-0af0-474c-9093-02db19628b4a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050802 Oct 15 09:16:37.747831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 946/1900] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:37 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:38.762337 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3baac407-1a21-4e0a-8527-a430bd34ef50 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af46310>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:38.807942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3baac407-1a21-4e0a-8527-a430bd34ef50 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049827 Oct 15 09:16:38.808485 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 955/1901] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:38 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:39.822097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-57045914-1c79-4a2f-ad97-7b25348cd6c3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e23a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:39.867158 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-57045914-1c79-4a2f-ad97-7b25348cd6c3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049299 Oct 15 09:16:39.867726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 947/1902] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:39 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:40.882275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c9b1668d-e3f2-4329-b959-1290ac16a978 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af963a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:40.932535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c9b1668d-e3f2-4329-b959-1290ac16a978 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.054509 Oct 15 09:16:40.933104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 956/1903] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:40 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:41.946980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8513de14-56b2-4d33-8923-de5f9bb632e4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6c820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:41.993045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8513de14-56b2-4d33-8923-de5f9bb632e4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050252 Oct 15 09:16:41.993601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 948/1904] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:41 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:43.007423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-463293eb-b2e6-41b5-b31b-b55fa17b5759 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adad3a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:43.053477 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-463293eb-b2e6-41b5-b31b-b55fa17b5759 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050160 Oct 15 09:16:43.054073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 957/1905] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:43 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:44.067467 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca3e21d4-4bfb-4a9e-9933-0beaa7664b33 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2e50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:44.113100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca3e21d4-4bfb-4a9e-9933-0beaa7664b33 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050316 Oct 15 09:16:44.113655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 949/1906] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:44 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:45.128970 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b416f30a-15c9-473c-beab-db3f1627eafb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c1daca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:45.174695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b416f30a-15c9-473c-beab-db3f1627eafb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050711 Oct 15 09:16:45.175245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 958/1907] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:45 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:46.190344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9c9c1fb6-d77d-4cfd-b287-b7a1e7a2a3ce tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:46.237109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9c9c1fb6-d77d-4cfd-b287-b7a1e7a2a3ce tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051848 Oct 15 09:16:46.237694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 950/1908] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:46 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:47.252558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7104c949-8634-47b6-8542-fc970d5f47bc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:47.297596 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7104c949-8634-47b6-8542-fc970d5f47bc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049978 Oct 15 09:16:47.298773 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 959/1909] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:47 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:48.312658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0ca75e97-1a47-4b98-b8fa-2d0c075445e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0c8b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:48.358048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0ca75e97-1a47-4b98-b8fa-2d0c075445e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049592 Oct 15 09:16:48.358652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 951/1910] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:49.372622 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b40b6981-7ded-4850-9cab-84da3209702b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2b1f0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:49.418789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b40b6981-7ded-4850-9cab-84da3209702b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050316 Oct 15 09:16:49.419631 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 960/1911] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:49 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:50.433637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-669a1fa7-9ef6-42a6-99ac-b7fb7f7c524c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:50.478896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-669a1fa7-9ef6-42a6-99ac-b7fb7f7c524c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049516 Oct 15 09:16:50.479453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 952/1912] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:50 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:51.493397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6da14134-5c99-4eef-8af9-bfb1c3743a0a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af968b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:51.538519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6da14134-5c99-4eef-8af9-bfb1c3743a0a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049391 Oct 15 09:16:51.539103 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 961/1913] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:51 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:52.552680 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-56d03c96-fb40-4d6f-ae7f-c3298db2984d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aafc280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:52.599708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-56d03c96-fb40-4d6f-ae7f-c3298db2984d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051252 Oct 15 09:16:52.600304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 953/1914] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:52 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:53.615085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6969c4dc-af04-4786-ae83-481c44210853 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e6103a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:53.661011 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6969c4dc-af04-4786-ae83-481c44210853 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050810 Oct 15 09:16:53.661558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 962/1915] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:53 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:54.676425 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1fa38cf5-30cf-47c8-9072-c2264a8f49a9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa58dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:54.723026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1fa38cf5-30cf-47c8-9072-c2264a8f49a9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051452 Oct 15 09:16:54.723610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 954/1916] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:54 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:55.736911 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4fa24e0a-de1e-41cb-a068-6defe1b82bfb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af49ca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:55.782010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4fa24e0a-de1e-41cb-a068-6defe1b82bfb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049580 Oct 15 09:16:55.782618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 963/1917] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:55 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:56.797181 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7f1de1b2-7e62-404b-b509-71a1e525bc10 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a790>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:56.842588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7f1de1b2-7e62-404b-b509-71a1e525bc10 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050201 Oct 15 09:16:56.843154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 955/1918] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:56 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:57.858318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1cc75680-6823-42d5-b009-8ae8c7848621 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0dd700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:57.903625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1cc75680-6823-42d5-b009-8ae8c7848621 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049651 Oct 15 09:16:57.904173 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 964/1919] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:57 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:58.917817 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17bde41f-1611-4de2-86e1-95496ab6c00c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa623a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:16:58.968260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17bde41f-1611-4de2-86e1-95496ab6c00c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.054755 Oct 15 09:16:58.968834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 956/1920] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:58 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:16:59.983307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d12cd5ec-9f63-49bd-85fa-0bd5173f8ffa tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad20e50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:00.030149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d12cd5ec-9f63-49bd-85fa-0bd5173f8ffa tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051474 Oct 15 09:17:00.030730 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 965/1921] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:16:59 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:01.045173 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-49c33b75-f936-49f3-81be-1a9f74e89070 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab270d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:01.091195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-49c33b75-f936-49f3-81be-1a9f74e89070 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050531 Oct 15 09:17:01.091879 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 957/1922] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:01 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:02.106449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-71e43758-63b5-4165-bdf0-611b16f64d95 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0dd700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:02.152183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-71e43758-63b5-4165-bdf0-611b16f64d95 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050175 Oct 15 09:17:02.152739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 966/1923] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:02 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:03.166921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7d4ee8ee-c9a7-462c-ab2b-a821d182f999 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad10160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:03.212236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7d4ee8ee-c9a7-462c-ab2b-a821d182f999 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049581 Oct 15 09:17:03.212796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 958/1924] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:03 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:04.226709 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0e00c633-7a68-4e84-813c-9a5a09d4f867 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af49ca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:04.272223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0e00c633-7a68-4e84-813c-9a5a09d4f867 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049728 Oct 15 09:17:04.272817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 967/1925] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:04 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:05.287163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0748b388-68fe-485b-bfd6-8dd3084ec605 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a790>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:05.333413 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0748b388-68fe-485b-bfd6-8dd3084ec605 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051087 Oct 15 09:17:05.334047 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 959/1926] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:05 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:06.348937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-691f5cbe-3853-4d95-82bc-f58c6631451d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae19d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:06.395421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-691f5cbe-3853-4d95-82bc-f58c6631451d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051557 Oct 15 09:17:06.396214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 968/1927] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:06 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:07.411042 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa6266aa-d73d-4d19-8c2a-3cd2f3c6a1ae tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aab8820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:07.457241 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aa6266aa-d73d-4d19-8c2a-3cd2f3c6a1ae tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051305 Oct 15 09:17:07.457842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 960/1928] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:07 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:08.472436 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b3f72a9f-be72-480a-9198-ed093407b1cc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b17d280>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:08.518388 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b3f72a9f-be72-480a-9198-ed093407b1cc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050887 Oct 15 09:17:08.518942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 969/1929] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:08 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:09.533275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-225d52ea-8e64-4310-a801-376078fa74d3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a790>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:09.578364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-225d52ea-8e64-4310-a801-376078fa74d3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049907 Oct 15 09:17:09.578923 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 961/1930] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:09 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:10.592801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1a3960a5-076e-46a4-ac3c-62cce3e6ec24 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43940>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:10.639736 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1a3960a5-076e-46a4-ac3c-62cce3e6ec24 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051192 Oct 15 09:17:10.646445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 970/1931] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:10 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:11.654383 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e1f7e588-3254-449a-ae7a-472bd37a7523 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b118280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:11.699506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e1f7e588-3254-449a-ae7a-472bd37a7523 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049503 Oct 15 09:17:11.700069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 962/1932] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:11 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:12.715139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1c5b6e5e-cf7b-4ca5-8163-87d1b114b7fe tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e21f0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:12.760142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1c5b6e5e-cf7b-4ca5-8163-87d1b114b7fe tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049391 Oct 15 09:17:12.760696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 971/1933] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:12 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:13.775128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9fd77356-ee6e-4571-9b50-7daf6f2d0cc7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b1405e0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:13.820856 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9fd77356-ee6e-4571-9b50-7daf6f2d0cc7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049906 Oct 15 09:17:13.821415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 963/1934] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:13 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:17:14.834866 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-dd0b05e3-4d25-4cdf-aeef-816f4fc3730a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0dd700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:14.881489 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-dd0b05e3-4d25-4cdf-aeef-816f4fc3730a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050883 Oct 15 09:17:14.882065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 972/1935] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:14 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:15.896978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e715d269-d6b2-4374-a68d-2f67d2e6b237 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62f70>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:15.942801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e715d269-d6b2-4374-a68d-2f67d2e6b237 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051084 Oct 15 09:17:15.943361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 964/1936] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:15 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:16.957422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d3604c36-eefa-4ed2-8b0b-88624958e80d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adad820>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:17.003139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d3604c36-eefa-4ed2-8b0b-88624958e80d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050179 Oct 15 09:17:17.003695 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 973/1937] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:16 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:18.017845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-99687ac8-a6f3-42c5-bff7-686416c81f21 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adc6040>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:18.063115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-99687ac8-a6f3-42c5-bff7-686416c81f21 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049850 Oct 15 09:17:18.064394 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 965/1938] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:18 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:19.078366 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6274963f-a1c7-4665-87a2-f0dca587943b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:19.124006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6274963f-a1c7-4665-87a2-f0dca587943b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049963 Oct 15 09:17:19.124594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 974/1939] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:19 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:20.139958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6b1902a4-6b3a-4987-978c-ddc3277ac761 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb70d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:20.185961 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6b1902a4-6b3a-4987-978c-ddc3277ac761 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050694 Oct 15 09:17:20.186561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 966/1940] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:20 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:21.200266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-08ce32d7-ce0d-4e66-8f0c-592634ea69bf tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af49820>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:21.245929 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-08ce32d7-ce0d-4e66-8f0c-592634ea69bf tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049877 Oct 15 09:17:21.246513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 975/1941] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:21 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:22.260736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e626908e-42b5-4e9c-8bd8-c78154304e02 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5e820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:22.306450 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e626908e-42b5-4e9c-8bd8-c78154304e02 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049999 Oct 15 09:17:22.307007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 967/1942] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:22 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:23.321051 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b56b9acb-ad2d-4bc7-8481-c9743191d9fc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2be50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:23.365537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b56b9acb-ad2d-4bc7-8481-c9743191d9fc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.048849 Oct 15 09:17:23.366132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 976/1943] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:23 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:24.380510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d9aaee2-d300-4216-9396-275b4fa5af86 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad10820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:24.427295 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d9aaee2-d300-4216-9396-275b4fa5af86 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050960 Oct 15 09:17:24.427889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 968/1944] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:24 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:25.442023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6d434e09-19cd-4231-84f9-89d0661ac1f7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c280>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:25.488214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6d434e09-19cd-4231-84f9-89d0661ac1f7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050549 Oct 15 09:17:25.489044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 977/1945] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:25 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:26.503332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3a091b65-8b8b-4f8e-b6da-a2fb0bc1c859 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb7a60>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:26.549867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3a091b65-8b8b-4f8e-b6da-a2fb0bc1c859 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051214 Oct 15 09:17:26.550432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 969/1946] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:26 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:27.565061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-bb89a5d7-2fc8-4221-9230-fc03bbdf0df5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0dd700>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:27.610405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-bb89a5d7-2fc8-4221-9230-fc03bbdf0df5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049641 Oct 15 09:17:27.610946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 978/1947] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:27 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:28.624240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-95cd66b9-f84b-495a-9e1f-de4435963fac tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad10160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:28.672893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-95cd66b9-f84b-495a-9e1f-de4435963fac tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.052348 Oct 15 09:17:28.673463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 970/1948] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:28 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:29.687553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d52f59cb-b554-4ea4-a6e9-3807cbe189b8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5740d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:29.733233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d52f59cb-b554-4ea4-a6e9-3807cbe189b8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049967 Oct 15 09:17:29.733813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 979/1949] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:29 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:30.747800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d09e4df8-0e3b-4d77-bafc-01febff0b8e6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a550>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:30.793121 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d09e4df8-0e3b-4d77-bafc-01febff0b8e6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049556 Oct 15 09:17:30.793702 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 971/1950] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:30 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:31.807947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3c8f3115-9ae0-4093-9b35-99b54b9a80eb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2daf0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:31.854214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3c8f3115-9ae0-4093-9b35-99b54b9a80eb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050441 Oct 15 09:17:31.854900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 980/1951] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:31 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:32.868177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b252bd2d-6ba9-403d-a681-5ba67a8bec38 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb7e50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:32.915144 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b252bd2d-6ba9-403d-a681-5ba67a8bec38 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051162 Oct 15 09:17:32.915726 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 972/1952] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:32 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:33.926409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:17:33.926889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:17:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 (ip 10.222.0.30) !!! Oct 15 09:17:33.932055 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1f00db1a-cc3c-407f-9da1-663121e91f6b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c218040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:33.981010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1f00db1a-cc3c-407f-9da1-663121e91f6b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.055407 Oct 15 09:17:33.981575 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 981/1953] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:34.995609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a7635d07-a8f4-46df-befc-4e39cb845d61 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad10820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:35.042411 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a7635d07-a8f4-46df-befc-4e39cb845d61 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051047 Oct 15 09:17:35.042964 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 973/1954] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:36.056635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5d42c161-7d59-40dc-a02b-07ba01c7e96f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b1d7790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:36.102539 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5d42c161-7d59-40dc-a02b-07ba01c7e96f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050126 Oct 15 09:17:36.103083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 982/1955] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:36 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:37.118682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-91369561-040b-434b-ac94-42077560fb25 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa54280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:37.164820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-91369561-040b-434b-ac94-42077560fb25 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050377 Oct 15 09:17:37.165426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 974/1956] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:37 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:38.179939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5495f8e6-7e36-49e8-bab5-8daab3b0c043 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae19820>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:38.224971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5495f8e6-7e36-49e8-bab5-8daab3b0c043 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.049405 Oct 15 09:17:38.225513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 983/1957] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:38 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:39.238777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa9e1494-368f-48fa-b5f2-1b839c07590f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e23a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:39.284543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aa9e1494-368f-48fa-b5f2-1b839c07590f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050208 Oct 15 09:17:39.285128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 975/1958] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:39 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:40.298879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8e7a59a9-0988-478a-9d70-7224fed68334 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:40.344367 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8e7a59a9-0988-478a-9d70-7224fed68334 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050215 Oct 15 09:17:40.344904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 984/1959] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:40 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:41.358780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46aad3e3-0f5b-43c4-8f13-2c9215ca07ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb7940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:41.405073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46aad3e3-0f5b-43c4-8f13-2c9215ca07ca tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050627 Oct 15 09:17:41.405636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 976/1960] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:41 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:42.419871 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f2a5d557-a99d-40fe-bd22-4ed2c7ed28fc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad605e0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:42.466734 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f2a5d557-a99d-40fe-bd22-4ed2c7ed28fc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051024 Oct 15 09:17:42.467281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 985/1961] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:42 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:43.482045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-89cc4d50-7cbc-4c71-9a72-999e6e01a991 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa64940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:43.528861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-89cc4d50-7cbc-4c71-9a72-999e6e01a991 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051055 Oct 15 09:17:43.529420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 977/1962] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:43 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:44.543569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-85ed511a-3276-4550-bca1-bb2e7eceba01 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac90550>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:44.589416 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-85ed511a-3276-4550-bca1-bb2e7eceba01 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050232 Oct 15 09:17:44.590024 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 986/1963] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:44 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:45.604029 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5ec1bc20-0e04-4cb6-b511-b66f8e285b9f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0cc10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:45.649880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5ec1bc20-0e04-4cb6-b511-b66f8e285b9f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050074 Oct 15 09:17:45.650392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 978/1964] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:45 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:46.664666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0ef4e4e7-1c75-415d-bfee-3ac41cf917c0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b046790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:46.712125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0ef4e4e7-1c75-415d-bfee-3ac41cf917c0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.051787 Oct 15 09:17:46.714893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 987/1965] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:46 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:47.728210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b5f2fb48-9ebe-49fc-82dd-9487a531b575 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad10160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:47.774071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b5f2fb48-9ebe-49fc-82dd-9487a531b575 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050118 Oct 15 09:17:47.774642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 979/1966] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:47 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:48.789375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1f5a5768-63c8-4b07-b2b8-89a36b60106c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba430>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:48.835227 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1f5a5768-63c8-4b07-b2b8-89a36b60106c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 353 microversion: 2.1 time: 0.050263 Oct 15 09:17:48.835814 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 988/1967] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:49.850555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8af3a78c-70c5-440d-845e-3bf10ef90506 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad7c9d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:49.898898 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8af3a78c-70c5-440d-845e-3bf10ef90506 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052943 Oct 15 09:17:49.899473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 980/1968] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:49 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:50.297638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0aad97a-1849-4f87-9f24-1145f1275d0a"}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:17:50.300084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:17:50.306139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:17:50.306632 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:17:50.307068 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:17:50.307758 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:17:50.308211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:17:50.308636 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:17:50.549172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ce629dd7-36b4-4498-a500-062fb1e5b563 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255485 Oct 15 09:17:50.550124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 989/1969] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 09:17:50 2022] POST /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:50.913201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e7bc4551-39c2-4637-8ab9-50731a07a0e1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62040>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:50.960216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e7bc4551-39c2-4637-8ab9-50731a07a0e1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051162 Oct 15 09:17:50.960787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 981/1970] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:50 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:51.975482 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f6e7e49-d152-4e40-baa7-d6fb1db38004 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0cf9d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:52.022835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f6e7e49-d152-4e40-baa7-d6fb1db38004 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052042 Oct 15 09:17:52.023415 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 990/1971] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:51 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:53.036677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9cfe6b36-ca73-437b-837f-a8cfbbffc0da tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb7310>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:53.081958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9cfe6b36-ca73-437b-837f-a8cfbbffc0da tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049455 Oct 15 09:17:53.082586 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 982/1972] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:53 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:54.150779 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d7956fa8-291d-4163-a846-4648382a06af tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba9d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:54.196363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d7956fa8-291d-4163-a846-4648382a06af tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049919 Oct 15 09:17:54.196938 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 991/1973] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:54 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:55.210950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-81413965-6ab9-425a-b8c0-47b307abf6bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5ee50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:55.260758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-81413965-6ab9-425a-b8c0-47b307abf6bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054018 Oct 15 09:17:55.261328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 983/1974] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:55 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:56.275240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a3dc8149-a0fd-4da9-83b7-f258c96ecd0f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad60160>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:56.321246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a3dc8149-a0fd-4da9-83b7-f258c96ecd0f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050175 Oct 15 09:17:56.321823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 992/1975] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:56 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:57.335976 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d489888d-1a39-4e07-85b3-2961dd371a4c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6bc10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:57.382516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d489888d-1a39-4e07-85b3-2961dd371a4c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050721 Oct 15 09:17:57.383090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 984/1976] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:57 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:58.396792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7174f660-dea9-46d1-a813-52305ebd3cf2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b1d7670>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:58.444550 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7174f660-dea9-46d1-a813-52305ebd3cf2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052042 Oct 15 09:17:58.445112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 993/1977] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:58 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:17:59.459079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3dd7c245-97fc-4d46-9cfb-a4910c1101b4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5ee50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:17:59.504659 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3dd7c245-97fc-4d46-9cfb-a4910c1101b4 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049803 Oct 15 09:17:59.505219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 985/1978] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:17:59 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:00.515692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:00.520663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3cc8e9ba-9899-480b-b904-8595f799727c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c430>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:00.539149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:00.566440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3cc8e9ba-9899-480b-b904-8595f799727c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052077 Oct 15 09:18:00.566996 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 994/1979] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:00 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:01.276249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:01.278559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:01.286039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:01.286535 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:01.287371 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:01.287683 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:01.288142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:01.288571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:01.333571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aa911b0f-374c-4517-9948-0878329ebdbf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061390 Oct 15 09:18:01.334167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 986/1980] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:18:01 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:01.346593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:01.347025 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:01.355547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:01.356076 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:01.356567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:01.357373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:01.357813 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:01.358247 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:01.396429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f83dc4b-5604-4269-abeb-77cebfc9c588 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a" status: 200 len: 194 microversion: 2.1 time: 0.054806 Oct 15 09:18:01.397044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 995/1981] 10.222.0.30 () {58 vars in 1413 bytes} [Sat Oct 15 09:18:01 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:01.580598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d585d1e8-a1dd-44bb-80d2-ddddacaf1f0b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb7310>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:01.635079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d585d1e8-a1dd-44bb-80d2-ddddacaf1f0b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.058393 Oct 15 09:18:01.635893 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 987/1982] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:01 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:02.651749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d46a65a4-0048-4674-b86c-3531b130e96d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c940>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:02.722985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d46a65a4-0048-4674-b86c-3531b130e96d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.077216 Oct 15 09:18:02.723545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 996/1983] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:02 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:02.737072 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1cfc4a-53d1-48c4-b9f9-6da2a6110bc8"}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:02.740179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:02.747621 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:02.748110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:02.748559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:02.749254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:02.750025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:02.750449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:03.063071 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-46ad2179-414a-4d3e-82f2-bf27e2890406 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "POST /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.330366 Oct 15 09:18:03.063914 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 988/1984] 10.222.0.30 () {60 vars in 1323 bytes} [Sat Oct 15 09:18:02 2022] POST /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:03.740315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-af7389fb-c923-4ba9-ace1-0c558c0e8c6c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba9d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:03.867022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-af7389fb-c923-4ba9-ace1-0c558c0e8c6c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.134140 Oct 15 09:18:03.867721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 997/1985] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:03 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:04.882942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2d2fc67f-50ea-4f48-a896-ca7d7ad56dcb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85af0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:04.931182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2d2fc67f-50ea-4f48-a896-ca7d7ad56dcb tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052284 Oct 15 09:18:04.932122 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 989/1986] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:04 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:05.946986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e2f86b6e-57df-4d63-b519-64f1f342122d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:05.993457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e2f86b6e-57df-4d63-b519-64f1f342122d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051781 Oct 15 09:18:05.994054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 998/1987] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:05 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:07.007470 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aaa0f53a-84df-42b7-9455-721f5452a70d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2d30>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:07.053437 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aaa0f53a-84df-42b7-9455-721f5452a70d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050159 Oct 15 09:18:07.054193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 990/1988] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:07 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:08.068668 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-77af12a2-4e95-4489-8afc-a77ac1357cfe tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad60790>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:08.115033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-77af12a2-4e95-4489-8afc-a77ac1357cfe tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051182 Oct 15 09:18:08.115593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 999/1989] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:08 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:09.130845 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ca68876e-9cf1-4eb8-b2d2-d16cef8df30b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6b670>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:09.179630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ca68876e-9cf1-4eb8-b2d2-d16cef8df30b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054164 Oct 15 09:18:09.180152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 991/1990] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:09 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:10.194531 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-53c648df-4b45-4f22-b27c-3317a5d76d29 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2be50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:10.240859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-53c648df-4b45-4f22-b27c-3317a5d76d29 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051084 Oct 15 09:18:10.247372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1000/1991] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:10 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:10.616925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:10.619339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:10.625505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.626021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.626452 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.627139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.627633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.628224 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.660014 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8415364a-4f30-4c51-9722-8e4907bbd016 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046714 Oct 15 09:18:10.661205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 992/1992] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:18:10 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:10.800764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:10.801483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:10.808210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.808701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.809768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.810431 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.811071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.811502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.844582 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-19d8eb70-f95f-47c7-9888-8732b9799096 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a" status: 200 len: 194 microversion: 2.1 time: 0.048799 Oct 15 09:18:10.845605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1001/1993] 10.222.0.30 () {58 vars in 1413 bytes} [Sat Oct 15 09:18:10 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:10.856973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:10.857525 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:10.865013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.865711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.866332 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.869671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:10.869671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:10.869671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:10.990099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lazy-loading 'services' on Instance uuid 5c0666ec-7c1a-4b8f-851c-757bd90c873a {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:18:11.079201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e4c043f6-9ea6-4602-bb82-520ad756df2e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a" status: 202 len: 0 microversion: 2.1 time: 0.226133 Oct 15 09:18:11.079793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 993/1994] 10.222.0.30 () {58 vars in 1416 bytes} [Sat Oct 15 09:18:10 2022] DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/c0aad97a-1849-4f87-9f24-1145f1275d0a => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:18:11.256014 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1625e9d9-8ec1-4117-8fd5-c1b380be9870 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2b4c0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:11.306176 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1625e9d9-8ec1-4117-8fd5-c1b380be9870 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.055580 Oct 15 09:18:11.306743 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1002/1995] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:11 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:12.224588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:12.225259 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:12.231613 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:12.232118 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:12.232537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:12.233235 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:12.233711 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:12.234148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:12.263998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2dfb26a2-d008-49a8-a8a1-2884170e25ef tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/1c1cfc4a-53d1-48c4-b9f9-6da2a6110bc8" status: 200 len: 194 microversion: 2.1 time: 0.044508 Oct 15 09:18:12.264602 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 994/1996] 10.222.0.30 () {58 vars in 1413 bytes} [Sat Oct 15 09:18:12 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/1c1cfc4a-53d1-48c4-b9f9-6da2a6110bc8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:12.276580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:12.277083 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:12.283714 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:12.284484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:12.284868 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:12.285569 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:12.286061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:12.286488 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:12.322374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8eb4668f-f890-44b2-8fbe-7a6cb9a7b1f9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e15e0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:12.380309 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8eb4668f-f890-44b2-8fbe-7a6cb9a7b1f9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.062786 Oct 15 09:18:12.387434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 995/1997] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:12 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:12.443692 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lazy-loading 'services' on Instance uuid 5c0666ec-7c1a-4b8f-851c-757bd90c873a {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:18:12.560634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-35388ce6-b6b2-4549-b037-0db2a952c2bf tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/1c1cfc4a-53d1-48c4-b9f9-6da2a6110bc8" status: 202 len: 0 microversion: 2.1 time: 0.288294 Oct 15 09:18:12.561423 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1003/1998] 10.222.0.30 () {58 vars in 1416 bytes} [Sat Oct 15 09:18:12 2022] DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments/1c1cfc4a-53d1-48c4-b9f9-6da2a6110bc8 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:18:13.395292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-48b81976-e09c-416b-a03e-62f1c4a106e6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:13.457998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-48b81976-e09c-416b-a03e-62f1c4a106e6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.066972 Oct 15 09:18:13.458571 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 996/1999] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:13 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:13.741843 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:13.744178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:13.750484 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:13.750960 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:13.751385 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:13.752149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:13.752545 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:13.752957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:13.781922 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-489d6a4a-570b-41eb-ab38-e2aa67fbbe4e tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045716 Oct 15 09:18:13.782464 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1004/2000] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:18:13 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 09:18:13.902032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:13.904040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:13.911557 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:13.912045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:13.912480 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:13.913177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:13.913653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:13.914087 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:13.945125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5a9e5c0a-40b6-42be-8a06-acffe722e5a9 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047255 Oct 15 09:18:13.945701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 997/2001] 10.222.0.30 () {58 vars in 1302 bytes} [Sat Oct 15 09:18:13 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 15 09:18:14.011074 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:14.011574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:14.017308 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:14.017819 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:14.018875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:14.019472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:14.019902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:14.020362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:14.045874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:18:14.121629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d3073a8e-f064-45b2-bddc-6411d76704eb tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 204 len: 0 microversion: 2.1 time: 0.113902 Oct 15 09:18:14.122470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1005/2002] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:18:14 2022] DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:18:14.131146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:14.131989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:14.137905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:14.138555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:14.138983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:14.139956 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:14.140421 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:14.140842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:14.280097 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:14.288655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-94d87349-ec8b-4c35-9a2f-2f07b8d19868 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1672 microversion: 2.1 time: 0.161577 Oct 15 09:18:14.289221 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 998/2003] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:14 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:14.472471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2b02f06b-f58b-4d47-a373-4fa7e4568e81 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575afd1ca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:14.523593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2b02f06b-f58b-4d47-a373-4fa7e4568e81 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.055472 Oct 15 09:18:14.539032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1006/2004] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:14 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:15.312847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:15.314109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:15.320488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:15.321044 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:15.322170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:15.322810 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:15.323389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:15.324855 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:15.546527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-99f2817f-c0d8-41e4-91ff-59a5d2f46e96 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5bab80>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:15.569034 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5d85f7efca040cc81253dfbf0de7c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becb9cd46453447a87846cf26561a190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:15.589890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86593de8-633f-4d0d-bc29-0d6af2f9bd51 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 200 len: 1672 microversion: 2.1 time: 0.278442 Oct 15 09:18:15.590940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 999/2005] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:15 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 1672 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:15.664159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-99f2817f-c0d8-41e4-91ff-59a5d2f46e96 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.122056 Oct 15 09:18:15.664721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1007/2006] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:15 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:16.049662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c0666ec-7c1a-4b8f-851c-757bd90c873a", "name": "network-vif-deleted", "tag": "0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:16.062147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:16.062971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:16.063614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:16.093707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] Creating event network-vif-deleted:0fc91dce-4e90-4d8b-bd8c-2d5bfc5fcd9f for instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a on hv-cinder-85697 Oct 15 09:18:16.129703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-9e8e1110-75ea-4cd2-a354-67c4887b4154 req-c3179548-2ce0-4bdb-8c36-fd36ee37a791 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284785 Oct 15 09:18:16.139900 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1000/2007] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:16.613865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:16.614686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:16.620953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:16.621466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:16.621904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:16.622790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:16.623243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:16.623662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:16.648213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] HTTP exception thrown: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Request method failure captured: Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a HTTP/1.1 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLwXVVkv1nzE-jqS8HlrNyMk8rUR1QXUT8zeGYwAkrKG_ciCR0vYj2YifX_04EwKPHXoPeXCCJ9f8o8V9NrmgVVwazAA2Fd2jMKRLHWXrJxSJmstRH5nE1AEaSA2F3rXh25wFM9QshyOl0j7GknzwnNukx6ObEJiCW3VT-Lh7sGFbU Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:18:16.649869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/becb9cd46453447a87846cf26561a190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_becb9cd46453447a87846cf26561a190", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: a5d85f7efca040cc81253dfbf0de7c42 Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:16.651086 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '5c0666ec-7c1a-4b8f-851c-757bd90c873a'} Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:18:16.651763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:16.654889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:16.656016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Returning 404 to user: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:18:16.656016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9e27e256-ab2f-45f8-a25b-8ae475250a35 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 404 len: 111 microversion: 2.1 time: 0.041942 Oct 15 09:18:16.656016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1008/2008] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:16 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:18:16.660720 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-58a46fc5-eccd-4986-872a-a377bc3a3965 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '.version_select at 0x7f575aa620d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:16.678935 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9aa1f053-9bde-42d0-813f-0a1c54c52be6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad60af0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:16.685959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-58a46fc5-eccd-4986-872a-a377bc3a3965 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-359580653" status: 202 len: 0 microversion: 2.1 time: 0.029267 Oct 15 09:18:16.701809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1001/2009] 10.222.0.30 () {58 vars in 1218 bytes} [Sat Oct 15 09:18:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-359580653 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:18:16.771246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9aa1f053-9bde-42d0-813f-0a1c54c52be6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.096108 Oct 15 09:18:16.771803 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1009/2010] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:16 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:17.285794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-756621110", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452"}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:17.344664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] validate_networks() for None {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:18:17.624533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:18:17.624968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:18:17.625446 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:18:17.625953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:18:17.626365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:18:17.635936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:17.636419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:17.636847 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:17.637561 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:17.638040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:17.638454 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:17.656401 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Getting quotas for project 9c5258b2dbd7421da1dce3db05030f54. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:18:17.660337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Getting quotas for user db9d9cc63fec4dac87214047576ea2f8 and project 9c5258b2dbd7421da1dce3db05030f54. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:18:17.671647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:18:17.674025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:18:17.718381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1ee4e602-f967-4ba5-9824-ef8bef3007cf tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.437201 Oct 15 09:18:17.719186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1002/2011] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:18:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 09:18:17.730778 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-529e9510-42f7-4e04-87be-971edf7e4794 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:17.731391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-529e9510-42f7-4e04-87be-971edf7e4794 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:17.786780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-06f1953c-5958-4d16-aec4-f9a256e3d6f5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0c940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:17.808822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-529e9510-42f7-4e04-87be-971edf7e4794 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:17.820348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-529e9510-42f7-4e04-87be-971edf7e4794 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1214 microversion: 2.1 time: 0.093868 Oct 15 09:18:17.821365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1010/2012] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:17 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:17.840203 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-06f1953c-5958-4d16-aec4-f9a256e3d6f5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.058111 Oct 15 09:18:17.841210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1003/2013] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:17 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:18.844428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:18.845042 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:18.852943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:18.853701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:18.854328 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:18.854854 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e33971b4-0497-4223-8098-3eaa9cd1c3a7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a550>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:18.855335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:18.855466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:18.856088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:18.916213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e33971b4-0497-4223-8098-3eaa9cd1c3a7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.065509 Oct 15 09:18:18.923443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1004/2014] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:18 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:18.941711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:18.951987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1faa9daa-f598-48ca-b100-2e60547979fb tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1274 microversion: 2.1 time: 0.111483 Oct 15 09:18:18.952721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1011/2015] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:18 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:19.610668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:19.611170 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:19.617963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.618459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.618896 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:19.619606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.620063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.620490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:19.637491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] HTTP exception thrown: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Request method failure captured: Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a HTTP/1.1 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnLwXVVkv1nzE-jqS8HlrNyMk8rUR1QXUT8zeGYwAkrKG_ciCR0vYj2YifX_04EwKPHXoPeXCCJ9f8o8V9NrmgVVwazAA2Fd2jMKRLHWXrJxSJmstRH5nE1AEaSA2F3rXh25wFM9QshyOl0j7GknzwnNukx6ObEJiCW3VT-Lh7sGFbU Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:18:19.639912 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/becb9cd46453447a87846cf26561a190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_becb9cd46453447a87846cf26561a190", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: a5d85f7efca040cc81253dfbf0de7c42 Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.641473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '5c0666ec-7c1a-4b8f-851c-757bd90c873a'} Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:18:19.642497 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.644828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.646471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Returning 404 to user: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:18:19.646471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1dff43cd-fa1c-4141-962c-b332d7433479 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 404 len: 111 microversion: 2.1 time: 0.034644 Oct 15 09:18:19.646471 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1005/2016] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:18:19 2022] DELETE /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:18:19.650599 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:19.651210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 5c0666ec-7c1a-4b8f-851c-757bd90c873a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:19.657474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.657999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.658434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:19.659139 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.659592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.660063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:19.674639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] HTTP exception thrown: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Request method failure captured: Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a HTTP/1.1 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLwXVVkv1nzE-jqS8HlrNyMk8rUR1QXUT8zeGYwAkrKG_ciCR0vYj2YifX_04EwKPHXoPeXCCJ9f8o8V9NrmgVVwazAA2Fd2jMKRLHWXrJxSJmstRH5nE1AEaSA2F3rXh25wFM9QshyOl0j7GknzwnNukx6ObEJiCW3VT-Lh7sGFbU Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:18:19.676447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/becb9cd46453447a87846cf26561a190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_becb9cd46453447a87846cf26561a190", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: a5d85f7efca040cc81253dfbf0de7c42 Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.677885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '5c0666ec-7c1a-4b8f-851c-757bd90c873a'} Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:18:19.678670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. Oct 15 09:18:19.679678 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:19.680578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Returning 404 to user: Instance 5c0666ec-7c1a-4b8f-851c-757bd90c873a could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:18:19.680578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-20b0f864-568b-4f66-a8f5-d700f9c48824 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a" status: 404 len: 111 microversion: 2.1 time: 0.031223 Oct 15 09:18:19.680578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1012/2017] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:19 2022] GET /compute/v2.1/servers/5c0666ec-7c1a-4b8f-851c-757bd90c873a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:18:19.932076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d3fe2ea0-3002-4290-b080-1b593ce83aae tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5e0d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:19.976605 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:19.977841 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:19.987876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.988382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.988822 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:19.989525 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:19.995557 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:19.996016 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:20.012414 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d3fe2ea0-3002-4290-b080-1b593ce83aae tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.083387 Oct 15 09:18:20.013135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1006/2018] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:19 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:20.244493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:20.252391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c4d27d44-d7d4-433a-8170-8f6b832c3ad2 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.279742 Oct 15 09:18:20.253626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1013/2019] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:19 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:18:20.699796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf78a31-392f-481d-ba82-bf8359baea9e", "tag": "78f300f4-bce3-4ace-97e3-a1a1a5b78efc"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:20.711740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:20.712359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:20.712924 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:20.723640 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] Creating event network-changed:78f300f4-bce3-4ace-97e3-a1a1a5b78efc for instance 3bf78a31-392f-481d-ba82-bf8359baea9e on hv-cinder-85697 Oct 15 09:18:20.728419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-8b61b43f-07ad-427c-a3b5-c33cd0c8abc8 req-6f2770ce-828f-4bec-9a5c-036fe594f916 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032583 Oct 15 09:18:20.729163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1007/2020] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:21.027132 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9332f61d-a140-4643-9fd8-bcdc2ff1ba95 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adadf70>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:21.075028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9332f61d-a140-4643-9fd8-bcdc2ff1ba95 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051713 Oct 15 09:18:21.075590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1014/2021] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:21 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:21.277423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:21.278147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:21.284777 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:21.285251 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:21.285692 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:21.286374 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:21.286820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:21.287312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:21.421828 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:21.430244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-50596f59-aca5-40f6-978b-c45db4fb6686 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.157562 Oct 15 09:18:21.430827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1008/2022] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:21 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:22.088728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5855fc0b-d62b-4b3e-ba5a-ffa0fab4896a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad20d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:22.135799 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5855fc0b-d62b-4b3e-ba5a-ffa0fab4896a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051318 Oct 15 09:18:22.136364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1015/2023] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:22 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:22.452239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:22.452941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:22.460226 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:22.460787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:22.461297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:22.462100 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:22.462559 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:22.462980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:22.680367 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:22.690245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b32ec42d-a5d2-4b8c-8783-7a9a554796c1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.241669 Oct 15 09:18:22.691515 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1009/2024] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:22 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:23.150501 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fe7d1866-1bf1-40fe-8f89-8ff01beb5df6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c5ba940>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:23.199023 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fe7d1866-1bf1-40fe-8f89-8ff01beb5df6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052766 Oct 15 09:18:23.199597 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1016/2025] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:23 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:23.716551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:23.717080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:23.724180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:23.724660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:23.725093 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:23.725808 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:23.726258 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:23.726681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:23.856418 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:23.864079 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e403fb07-2aa6-44ba-b959-def2e783ac41 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.151532 Oct 15 09:18:23.864639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1010/2026] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:23 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:24.213666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a737500c-fa66-42eb-83b1-e7228948a63f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2daf0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:24.261001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a737500c-fa66-42eb-83b1-e7228948a63f tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051544 Oct 15 09:18:24.261559 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1017/2027] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:24 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:24.886974 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:24.887490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:24.894593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:24.895073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:24.895500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:24.896175 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:24.896656 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:24.897176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:25.020737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:25.028393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-412feb5e-716c-47d0-a7a2-a0c353b4f12a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.145355 Oct 15 09:18:25.028940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1011/2028] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:24 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:25.275925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-097d76ba-7b66-44b0-9d24-f18f52e2a8d2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0dd160>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:25.324088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-097d76ba-7b66-44b0-9d24-f18f52e2a8d2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052377 Oct 15 09:18:25.324665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1018/2029] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:25 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:26.051947 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:26.052558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:26.059018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:26.059499 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:26.059931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:26.060616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:26.061099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:26.061522 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:26.198681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:26.208639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8fce7b06-87c3-4284-bdd9-197048672f27 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.160851 Oct 15 09:18:26.209533 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1012/2030] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:26 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:26.338516 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f5a4f060-8baf-40d0-b611-4afc2f94f1bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab275e0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:26.389139 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f5a4f060-8baf-40d0-b611-4afc2f94f1bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054584 Oct 15 09:18:26.389727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1013/2031] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:26 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:26.482981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf78a31-392f-481d-ba82-bf8359baea9e", "name": "network-vif-plugged", "status": "completed", "tag": "78f300f4-bce3-4ace-97e3-a1a1a5b78efc"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:26.493392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:26.493899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:26.494326 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:26.504282 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] Creating event network-vif-plugged:78f300f4-bce3-4ace-97e3-a1a1a5b78efc for instance 3bf78a31-392f-481d-ba82-bf8359baea9e on hv-cinder-85697 Oct 15 09:18:26.509206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-6a583edf-8c9a-49fc-9607-297f933c8a88 req-94f30e5e-c3e5-44ee-abf3-f1c0a20d0b9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217409 Oct 15 09:18:26.509797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1019/2032] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:27.231142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:27.231694 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:27.237620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:27.238216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:27.238675 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:27.239348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:27.239797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:27.240215 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:27.247101 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:27.374396 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:27.382505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-027001a0-d869-4fcc-b19a-9c8d8c9fa1ef tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1314 microversion: 2.1 time: 0.155656 Oct 15 09:18:27.383074 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1014/2033] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:27 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:27.404379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1a093439-cc72-4e43-9c2a-aa177b894faa tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e610af0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:27.450187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1a093439-cc72-4e43-9c2a-aa177b894faa tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050477 Oct 15 09:18:27.450741 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1020/2034] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:27 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:28.405707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:28.406324 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:28.408180 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:28.408864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:28.415138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.415620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.416056 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.416746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.417200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.417625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.461404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:28.465986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7d749063-b028-45ab-b13b-b8690d46454a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56ce50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:28.515869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7d749063-b028-45ab-b13b-b8690d46454a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.055239 Oct 15 09:18:28.516512 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1021/2035] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:28 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:28.552550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:28.560201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a99f3dec-8878-4d46-a5fe-63abb05ba281 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1463 microversion: 2.1 time: 0.158445 Oct 15 09:18:28.560756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1015/2036] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:28 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:28.606404 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:28.607049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:28.613188 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.613671 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.614126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.614808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.615266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.615686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.641196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:18:28.714978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f31efa00-adda-4ce1-91a5-b7a7055b3a8a tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "DELETE /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 204 len: 0 microversion: 2.1 time: 0.112025 Oct 15 09:18:28.715473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1022/2037] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:18:28 2022] DELETE /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:18:28.726319 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:28.726955 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:28.732882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.733359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.733812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.734491 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:28.734939 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:28.735356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:28.859916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:28.867506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fd30567b-bd96-4619-b281-4281bf190df6 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1469 microversion: 2.1 time: 0.147065 Oct 15 09:18:28.868066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1016/2038] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:28 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:29.531072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-609e9e36-b720-413d-9339-24a899462f94 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad60040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:29.579889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-609e9e36-b720-413d-9339-24a899462f94 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053265 Oct 15 09:18:29.580468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1023/2039] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:29 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:29.891048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:29.891663 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:29.898227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:29.898709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:29.899145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:29.899837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:29.900281 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:29.900704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:30.031321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9d9cc63fec4dac87214047576ea2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c5258b2dbd7421da1dce3db05030f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:18:30.046859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a0c81f5c-4f9d-4831-967d-ae2691cbd6e1 tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 200 len: 1469 microversion: 2.1 time: 0.159595 Oct 15 09:18:30.047686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1017/2040] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:29 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:18:30.497283 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf78a31-392f-481d-ba82-bf8359baea9e", "name": "network-vif-deleted", "tag": "78f300f4-bce3-4ace-97e3-a1a1a5b78efc"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:30.508343 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:30.508823 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:30.509250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:30.522189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] Creating event network-vif-deleted:78f300f4-bce3-4ace-97e3-a1a1a5b78efc for instance 3bf78a31-392f-481d-ba82-bf8359baea9e on hv-cinder-85697 Oct 15 09:18:30.527057 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-6d49d9ac-c646-4338-9071-12901be6292e req-2d83f068-f6e4-48e0-bec9-6fdb220d081c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033721 Oct 15 09:18:30.527651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1024/2041] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:30.594721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8693ef59-17c4-45d5-b1ac-36ed1b59d259 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aaddaf0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:30.644508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8693ef59-17c4-45d5-b1ac-36ed1b59d259 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053059 Oct 15 09:18:30.645204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1018/2042] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:30 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:31.071345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:31.072183 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] [instance: 3bf78a31-392f-481d-ba82-bf8359baea9e] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:18:31.074108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:31.079959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:31.080442 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:31.080943 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:31.081618 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:18:31.082091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:18:31.082504 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:18:31.088275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:31.101184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] HTTP exception thrown: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Request method failure captured: Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e HTTP/1.1 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnrXlQ8kZzLgwswpFFdUdmO33c_3rbmCpkaeAADtoJluMsWq_NTCsCnPUKYG13qriIV9eJYiyiCEZR9g35ZUgitVUi5W2U7eRewz_94B0rwqrLBKdjT5soQUSPfjxTnKkI9GB_4O9IXkNpBMMO9UHma1bL8f_MIzLuAd8AKEUJs4UHY Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 9c5258b2dbd7421da1dce3db05030f54 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesNegativeTest-501896312 Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:18:31.103065 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c5258b2dbd7421da1dce3db05030f54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/9c5258b2dbd7421da1dce3db05030f54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/9c5258b2dbd7421da1dce3db05030f54"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_9c5258b2dbd7421da1dce3db05030f54", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesNegativeTest-501896312 Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 9c5258b2dbd7421da1dce3db05030f54 Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesNegativeTest-501896312 Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesNegativeTest-501896312-project Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: db9d9cc63fec4dac87214047576ea2f8 Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesNegativeTest-501896312-project Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. Oct 15 09:18:31.104527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '3bf78a31-392f-481d-ba82-bf8359baea9e'} Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:18:31.110312 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. Oct 15 09:18:31.111661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:18:31.112924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] Returning 404 to user: Instance 3bf78a31-392f-481d-ba82-bf8359baea9e could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:18:31.112924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ee77b40f-8907-4175-8347-4e8c69dc7e1f tempest-VolumesNegativeTest-501896312 tempest-VolumesNegativeTest-501896312-project] 10.222.0.30 "GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e" status: 404 len: 111 microversion: 2.1 time: 0.038559 Oct 15 09:18:31.112924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1025/2043] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:18:31 2022] GET /compute/v2.1/servers/3bf78a31-392f-481d-ba82-bf8359baea9e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:18:31.658803 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a39359df-f6d9-4d9d-982d-e0d68469b1d9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aeab8b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:31.706099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a39359df-f6d9-4d9d-982d-e0d68469b1d9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051477 Oct 15 09:18:31.706658 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1019/2044] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:31 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:32.720380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a80e5688-3954-4e0a-9944-7203546e60e1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43940>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:32.769009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a80e5688-3954-4e0a-9944-7203546e60e1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052639 Oct 15 09:18:32.769567 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1026/2045] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:32 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:33.783322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d60b9743-e9d0-40f9-bc10-fb045ad16948 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575abb78b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:33.836917 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d60b9743-e9d0-40f9-bc10-fb045ad16948 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.057775 Oct 15 09:18:33.837614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1020/2046] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:34.851364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ff4803b7-34b3-4504-ba9c-6617260ed205 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8040>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:34.900348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ff4803b7-34b3-4504-ba9c-6617260ed205 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053127 Oct 15 09:18:34.900902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1027/2047] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:35.916591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f98c8198-e2a4-4632-a34d-95d0755d2d5c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e2700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:35.967723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f98c8198-e2a4-4632-a34d-95d0755d2d5c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.055994 Oct 15 09:18:35.968457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1021/2048] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:35 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:36.982413 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-988aec14-16d7-49dd-a09f-0f478696d7e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c670>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:37.035801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-988aec14-16d7-49dd-a09f-0f478696d7e9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.057723 Oct 15 09:18:37.036397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1028/2049] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:36 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:38.051500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f995aa01-66bd-419b-9773-461f9d68fd3a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab0c790>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:38.123600 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f995aa01-66bd-419b-9773-461f9d68fd3a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.076977 Oct 15 09:18:38.124196 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1022/2050] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:38 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:39.141097 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8b872225-3dba-4381-bfe0-6b1aa36719f6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad8ae50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:39.198493 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8b872225-3dba-4381-bfe0-6b1aa36719f6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.065095 Oct 15 09:18:39.199297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1029/2051] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:39 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:40.209973 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:40.210887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=22 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:40.217239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-8b03e5e5-38c7-49df-b7bd-83d4121badc2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab275e0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:40.279750 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-8b03e5e5-38c7-49df-b7bd-83d4121badc2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.071209 Oct 15 09:18:40.280807 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1023/2052] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:40 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:41.291937 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:41.296284 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5e0dda73-4d58-48fd-8f4a-074be65a6202 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43dc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:41.352800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5e0dda73-4d58-48fd-8f4a-074be65a6202 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.062071 Oct 15 09:18:41.356066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1030/2053] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:41 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:42.370902 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6038edfd-725c-49a4-9512-399f9fee3708 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aadd0d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:42.428643 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6038edfd-725c-49a4-9512-399f9fee3708 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.061560 Oct 15 09:18:42.429469 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1024/2054] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:42 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:43.442373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4ba97cad-5761-4f3f-a1d2-a9f60b439ce5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5740d0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:43.449704 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:43.540010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4ba97cad-5761-4f3f-a1d2-a9f60b439ce5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.101376 Oct 15 09:18:43.540859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1031/2055] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:43 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:44.555225 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-544a4d6f-56bd-445b-8cf8-f3845cefec54 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575a9e23a0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:44.621254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-544a4d6f-56bd-445b-8cf8-f3845cefec54 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.070484 Oct 15 09:18:44.621867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1025/2056] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:44 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:45.283092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-51594fb0-b686-4ddc-b412-1ac5191ac3c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Action: 'create', calling method: .version_select at 0x7f575af2daf0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2107611068", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUIjEmgmltZB2xkAZAFXG6/JBUcKnag2D1HNa1CKRVHHBfL/c7XIyxERkcbyltkkd8KP5vpvqAf5xwLuDzBwtmT+fsEzupSTqijz0SuX7RP5Gs2GwAGn9IBr272n0748g=="}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:18:45.300030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-51594fb0-b686-4ddc-b412-1ac5191ac3c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Getting quotas for project 6c1e74e55af54016b9e63666c1594675. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:18:45.304881 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-51594fb0-b686-4ddc-b412-1ac5191ac3c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Getting quotas for user 440ce33b27fa46f6aaeab9184d8ef5a3 and project 6c1e74e55af54016b9e63666c1594675. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:18:45.333928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-51594fb0-b686-4ddc-b412-1ac5191ac3c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.268230 Oct 15 09:18:45.335387 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1032/2057] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 09:18:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:45.635781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a2d3e8c3-70f2-4e09-82b0-c63afed3ba78 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c96d430>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:45.689068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a2d3e8c3-70f2-4e09-82b0-c63afed3ba78 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.057708 Oct 15 09:18:45.689882 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1026/2058] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:45 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:46.712226 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7e461893-3a24-4475-88dd-7a3f9e48818c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e2940>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:46.768882 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7e461893-3a24-4475-88dd-7a3f9e48818c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.068281 Oct 15 09:18:46.780646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1033/2059] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:46 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:47.784632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-76222d03-c20a-4533-ab13-1832ac3730dc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae68700>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:47.842294 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-76222d03-c20a-4533-ab13-1832ac3730dc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.061936 Oct 15 09:18:47.842870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1027/2060] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:47 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:48.857320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e9593ad3-08be-4dd3-9ba5-237acb9e6916 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56cb80>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:48.910355 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e9593ad3-08be-4dd3-9ba5-237acb9e6916 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.057835 Oct 15 09:18:48.910925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1034/2061] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:18:49.926547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a5ba37a7-c335-4d9b-8b7d-1f4574b257b9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aab8160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:49.983043 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a5ba37a7-c335-4d9b-8b7d-1f4574b257b9 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.060750 Oct 15 09:18:49.983616 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1028/2062] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:49 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:50.999147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4da14ddf-089c-4ac1-a4a3-41d198972537 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575af2daf0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:51.048102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4da14ddf-089c-4ac1-a4a3-41d198972537 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054430 Oct 15 09:18:51.048699 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1035/2063] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:50 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:52.062754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e273e2c3-c568-4716-9bc6-8990d7e023ef tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:52.112153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e273e2c3-c568-4716-9bc6-8990d7e023ef tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053088 Oct 15 09:18:52.112723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1029/2064] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:52 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:53.126552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a997d5c8-d32e-4746-8635-6ec57e178704 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae43dc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:53.176998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a997d5c8-d32e-4746-8635-6ec57e178704 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054684 Oct 15 09:18:53.177637 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1036/2065] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:53 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:54.192610 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-df299648-fa24-4c7c-8a11-6a74dda8749d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6a790>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:54.241554 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-df299648-fa24-4c7c-8a11-6a74dda8749d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053122 Oct 15 09:18:54.242671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1030/2066] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:54 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:55.257897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e8348c72-f55e-40ff-b21c-c7430f5ec27c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b16f160>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:55.309808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e8348c72-f55e-40ff-b21c-c7430f5ec27c tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.056284 Oct 15 09:18:55.310372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1037/2067] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:55 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:56.325111 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7b363944-fcf1-419b-aff0-3a2e57c7a98b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa851f0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:56.370848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7b363944-fcf1-419b-aff0-3a2e57c7a98b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050835 Oct 15 09:18:56.371435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1031/2068] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:56 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:57.380912 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:57.381669 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:18:57.385999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4cd0e268-c4ed-4063-98b0-2c606f58567a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56cdc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:57.433532 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4cd0e268-c4ed-4063-98b0-2c606f58567a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053212 Oct 15 09:18:57.434204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1038/2069] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:57 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:58.448137 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0aab3056-f802-4963-9a7d-5ee83044c3bf tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ac6b670>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:58.493740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0aab3056-f802-4963-9a7d-5ee83044c3bf tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049871 Oct 15 09:18:58.494291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1032/2070] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:58 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:18:59.508856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-6ad34194-fef7-446f-8f66-1daf99b4383d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e2160>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:18:59.553793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-6ad34194-fef7-446f-8f66-1daf99b4383d tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049691 Oct 15 09:18:59.554873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1039/2071] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:18:59 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:00.542787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2115787465", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2107611068", "security_groups": [{"name": "tempest-secgroup-smoke-1898326778"}], "networks": [{"uuid": "4606d872-858b-4184-a281-c21dc43f0748"}], "block_device_mapping_v2": [{"uuid": "6e122785-072f-4270-9b82-30c26fe2e796", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:19:00.568690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c83f94f7-85eb-47a9-b8be-5e394ced6399 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c8b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:00.615223 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c83f94f7-85eb-47a9-b8be-5e394ced6399 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050730 Oct 15 09:19:00.615796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1040/2072] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:00 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:19:00.656899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] validate_networks() for [('4606d872-858b-4184-a281-c21dc43f0748', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:19:01.134210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:19:01.134706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:19:01.135298 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:19:01.135994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:19:01.136583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:19:01.145485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:01.146069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:01.146512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:01.147240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:01.147698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:01.148123 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:01.165944 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Getting quotas for project 6c1e74e55af54016b9e63666c1594675. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:19:01.170716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Getting quotas for user 440ce33b27fa46f6aaeab9184d8ef5a3 and project 6c1e74e55af54016b9e63666c1594675. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:19:01.228718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:19:01.230840 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e122785-072f-4270-9b82-30c26fe2e796',volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:19:01.362351 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f7c7d3fe-a796-4af3-86f2-103e467bbad4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823805 Oct 15 09:19:01.363006 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1033/2073] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:19:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 09:19:01.374150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0258a35b-ee3e-4a70-9ee0-2a7f76ba2b3b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:01.374764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0258a35b-ee3e-4a70-9ee0-2a7f76ba2b3b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:01.429971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0258a35b-ee3e-4a70-9ee0-2a7f76ba2b3b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:01.437391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0258a35b-ee3e-4a70-9ee0-2a7f76ba2b3b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1089 microversion: 2.1 time: 0.066914 Oct 15 09:19:01.437981 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1041/2074] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:01 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:01.629789 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-193771e8-2b7b-4ceb-9921-dd0f4f116c27 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85b80>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:01.680082 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-193771e8-2b7b-4ceb-9921-dd0f4f116c27 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054259 Oct 15 09:19:01.681142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1034/2075] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:01 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:02.460170 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:02.460837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:02.467930 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:02.468476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:02.468968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:02.469740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:02.470255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:02.470735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:02.558676 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:02.566447 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c74969bd-1e0f-4acf-ad43-12c6cd2dc740 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1205 microversion: 2.1 time: 0.110027 Oct 15 09:19:02.567005 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1042/2076] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:02 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1205 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:02.695163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d5b94a82-05dd-4fe6-a1e3-9e2e1735151b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa64940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:02.743942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d5b94a82-05dd-4fe6-a1e3-9e2e1735151b tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052874 Oct 15 09:19:02.744753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1035/2077] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:02 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:03.589738 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:03.590392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:03.596824 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:03.597303 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:03.597784 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:03.598474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:03.598923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:03.599365 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:03.751231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:19:03.764037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:03.764560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:03.764989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:03.776926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] Creating event network-changed:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:19:03.782216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-141742c2-587f-41ab-bd6f-3487d82c68ad req-1191d0b3-b3c3-434e-8fd3-8201b285f2b6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035545 Oct 15 09:19:03.782814 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1036/2078] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:19:03.788277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1041f103-2495-4786-ba90-89b75043c6b0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27b80>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:03.831728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:03.838107 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1041f103-2495-4786-ba90-89b75043c6b0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053982 Oct 15 09:19:03.839011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1037/2079] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:03 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:03.842095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-de6c73c1-6c15-450a-be60-3401fef4cf43 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.256433 Oct 15 09:19:03.842705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1043/2080] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:03 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:04.852769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7db1dde8-dc09-4fa6-ae74-b0e29dcdf142 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:04.866521 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:04.867137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:04.874160 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:04.874639 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:04.875066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:04.875749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:04.876196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:04.876611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:04.899677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7db1dde8-dc09-4fa6-ae74-b0e29dcdf142 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051145 Oct 15 09:19:04.900255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1038/2081] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:04 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:05.010443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:05.018044 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84b82672-42df-4c7b-8f68-77af1ae936d2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.155324 Oct 15 09:19:05.018592 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1044/2082] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:04 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:19:05.914303 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d7ef40f0-ce4e-4c14-a4e4-f9283699a3cc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5e820>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:05.960174 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d7ef40f0-ce4e-4c14-a4e4-f9283699a3cc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050167 Oct 15 09:19:05.960721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1039/2083] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:05 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:06.040318 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:06.040923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:06.047514 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:06.047990 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:06.048422 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:06.049104 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:06.049553 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:06.050001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:06.175466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:06.183836 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-94b7d4ce-1c45-46a4-9a95-901fc54884de tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.147336 Oct 15 09:19:06.184389 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1045/2084] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:06 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:06.975143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-890a011c-ed21-4f74-9970-27e947a03215 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85af0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:07.019830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-890a011c-ed21-4f74-9970-27e947a03215 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.048949 Oct 15 09:19:07.020391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1040/2085] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:06 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:07.206987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:07.207633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:07.214356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:07.214830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:07.215255 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:07.215928 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:07.216372 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:07.216790 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:07.346800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:07.354580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-51959a39-e29e-4ffe-b140-9233b7aff8a5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.151348 Oct 15 09:19:07.355147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1046/2086] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:07 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:08.035077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d81848cd-d8f6-4a5e-b537-f5c646f42020 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:08.081555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d81848cd-d8f6-4a5e-b537-f5c646f42020 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050844 Oct 15 09:19:08.082159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1041/2087] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:08 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:08.377377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:08.378945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:08.385595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:08.386102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:08.386535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:08.387236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:08.387690 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:08.388109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:08.517105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:08.525323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7f4e430a-84e0-4602-a774-66d5b3f46a6f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.152042 Oct 15 09:19:08.525906 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1047/2088] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:08 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:09.095641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2d1c2b96-0195-4182-a14b-f5932bb8eb79 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62e50>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:09.141940 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2d1c2b96-0195-4182-a14b-f5932bb8eb79 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050417 Oct 15 09:19:09.142496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1042/2089] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:09 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:09.548798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:09.549403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:09.556373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:09.556854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:09.557280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:09.557986 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:09.558439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:09.558859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:09.684534 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:09.692147 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b0f2b80e-cac0-40ec-91c3-1fc3061e8995 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.147487 Oct 15 09:19:09.692702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1048/2090] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:09 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:10.156631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-61b0156b-1abf-48ac-942a-c5833f0a7532 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab278b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:10.201484 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-61b0156b-1abf-48ac-942a-c5833f0a7532 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049129 Oct 15 09:19:10.202068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1043/2091] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:10 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:10.714533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:10.715137 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:10.721481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:10.721985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:10.722419 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:10.723096 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:10.723544 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:10.723966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:10.854359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:10.862483 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-75a3d087-be33-4dd1-b7ca-03e9bb2349cc tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.151717 Oct 15 09:19:10.868466 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1049/2092] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:10 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:11.213103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:11.213833 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:11.217950 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-990df78c-7959-45e9-8810-9e1f9c79c8a2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85280>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:11.263646 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-990df78c-7959-45e9-8810-9e1f9c79c8a2 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051897 Oct 15 09:19:11.264205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1044/2093] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:11 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:11.885854 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:11.886474 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:11.889357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:11.893390 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:11.893950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:11.894546 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:11.895248 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:11.895708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:11.896136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:12.023857 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:12.031794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b16a0d55-db84-4c4b-b8c1-032afa577109 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.150589 Oct 15 09:19:12.032345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1050/2094] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:11 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:12.277408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2b4936d4-b196-463a-ad34-270f771bbfdc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa628b0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:12.332823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2b4936d4-b196-463a-ad34-270f771bbfdc tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.059634 Oct 15 09:19:12.333380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1045/2095] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:12 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:13.054740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:13.055342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:13.061917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:13.062405 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:13.062847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:13.063540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:13.063995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:13.064421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:13.196830 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:13.204435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-4c34f0cb-8738-41f9-a70a-847d01cee24c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.153512 Oct 15 09:19:13.204985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1051/2096] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:13 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:13.347354 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ad29b218-0e5e-4ac8-a3c0-297f911f10d8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:13.393152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ad29b218-0e5e-4ac8-a3c0-297f911f10d8 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049959 Oct 15 09:19:13.393734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1046/2097] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:13 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:14.228338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:14.229473 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:14.236130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:14.236633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:14.237061 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:14.237768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:14.238219 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:14.238640 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:14.365942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:14.373959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7db06542-e17c-4a4f-965c-2a6541ba25cf tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.149504 Oct 15 09:19:14.374603 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1052/2098] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:14 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:14.405061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:14.406213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:14.411508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5fb6d7c8-da35-460c-97c5-e0d7ae59f3c0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27b80>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:14.464136 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5fb6d7c8-da35-460c-97c5-e0d7ae59f3c0 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.059796 Oct 15 09:19:14.464729 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1047/2099] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:14 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:14.510936 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "name": "network-vif-plugged", "status": "completed", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:19:14.521017 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:14.521467 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:14.521918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:14.534269 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] Creating event network-vif-plugged:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:19:14.539302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-e1281236-e039-47d0-803e-998933fef914 req-cf160737-3fc5-4af6-a293-500ac2180877 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 Oct 15 09:19:14.539885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1053/2100] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:15.396084 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:15.396749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:15.403519 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:15.404007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:15.404442 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:15.405140 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:15.405662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:15.406045 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:15.479588 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-09a7be10-a872-4ac1-88fa-7a7a3b2b02ec tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8a60>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:15.529392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-09a7be10-a872-4ac1-88fa-7a7a3b2b02ec tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.054442 Oct 15 09:19:15.529999 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1054/2101] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:15 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:19:15.543772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:15.551695 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-329c1c05-c54d-4cb2-b53b-cf1febdddc5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1261 microversion: 2.1 time: 0.159578 Oct 15 09:19:15.552292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1048/2102] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:15 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:16.543971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3aab6e61-03b8-479c-abff-8db2401bbfd5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575b0cadc0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:16.575601 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:16.576292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:16.582723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:16.583200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:16.583632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:16.584312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:16.584758 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:16.585171 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:16.590392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3aab6e61-03b8-479c-abff-8db2401bbfd5 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050760 Oct 15 09:19:16.591006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1055/2103] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:16 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:16.712716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:16.720321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-7e0def63-76b3-4d46-9ef1-3512222dcaf4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1446 microversion: 2.1 time: 0.149403 Oct 15 09:19:16.720885 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1049/2104] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:16 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1446 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:19:16.742796 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:16.743556 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:19:16.750703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:16.751186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:16.751620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:16.752313 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:16.752772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:16.753196 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:16.883373 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:19:16.891037 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f73979d5-b955-443a-ab0c-19256f7bdc46 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1446 microversion: 2.1 time: 0.152125 Oct 15 09:19:16.891595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1056/2105] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:19:16 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:19:17.604946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2dd46351-7de7-4e54-b227-b94cd24122ea tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab6eca0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:17.653926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2dd46351-7de7-4e54-b227-b94cd24122ea tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053383 Oct 15 09:19:17.654584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1050/2106] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:17 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:18.668245 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-8e97f8c7-8a03-497b-bc2d-7cd149705d14 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ad20e50>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:18.718462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-8e97f8c7-8a03-497b-bc2d-7cd149705d14 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053981 Oct 15 09:19:18.719205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1057/2107] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:18 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:18.730568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:19:18.740339 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:19:18.740819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:19:18.741249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:19:18.752108 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] Creating event network-changed:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:19:18.757078 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-8176bdae-e4b1-43b9-a5de-bbdcab4c38e8 req-297bed65-f192-4600-90b5-39d8a43475de service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Oct 15 09:19:18.757920 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1051/2108] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:19:19.732991 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-eb2a52b6-9e9d-4eab-b9b1-0a14326537e7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e6108b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:19.779530 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-eb2a52b6-9e9d-4eab-b9b1-0a14326537e7 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051028 Oct 15 09:19:19.780172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1058/2109] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:19 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:20.794998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f23d7ac0-2295-46f0-a529-aed171b2cec1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85670>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:20.842372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f23d7ac0-2295-46f0-a529-aed171b2cec1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052557 Oct 15 09:19:20.842959 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1052/2110] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:20 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:21.856547 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0845f3c9-8c0b-492f-8bbb-1ddaa1fa42b6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5f5ca0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:21.903334 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0845f3c9-8c0b-492f-8bbb-1ddaa1fa42b6 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050926 Oct 15 09:19:21.903924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1059/2111] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:21 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:22.918685 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-aef18a30-f813-4cc0-9c2e-e534c9d70b93 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab6eb80>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:22.964296 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-aef18a30-f813-4cc0-9c2e-e534c9d70b93 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050475 Oct 15 09:19:22.964843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1053/2112] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:22 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:23.978847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-338bab72-c477-4fb6-9461-b5041b242f10 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8d30>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:24.024092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-338bab72-c477-4fb6-9461-b5041b242f10 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049497 Oct 15 09:19:24.024683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1060/2113] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:23 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:25.038297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f160d201-4890-4044-b45e-e216e44a36b3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5e0d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:25.083154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f160d201-4890-4044-b45e-e216e44a36b3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049253 Oct 15 09:19:25.083709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1054/2114] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:25 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:26.098222 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-49e1f37d-3cc1-4994-b18d-20abc7ddd0bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e610af0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:26.143910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-49e1f37d-3cc1-4994-b18d-20abc7ddd0bd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049980 Oct 15 09:19:26.144456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1061/2115] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:26 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:27.157771 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-71542fec-b3cd-4105-8940-9c450ae5c0dd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab89d30>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:27.203510 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-71542fec-b3cd-4105-8940-9c450ae5c0dd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050087 Oct 15 09:19:27.204189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1055/2116] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:27 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:28.215246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=30 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:28.216009 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=74 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:28.220551 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-56ee2168-4410-4815-b725-ce4a25f9cb3a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5f5430>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:28.267655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-56ee2168-4410-4815-b725-ce4a25f9cb3a tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052977 Oct 15 09:19:28.268215 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1062/2117] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:28 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:29.278843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:29.279591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=14 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:19:29.285868 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0585904b-dad9-49c6-b11a-fa019923e852 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ab27dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:29.335275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0585904b-dad9-49c6-b11a-fa019923e852 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.057568 Oct 15 09:19:29.335859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1056/2118] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:29 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:30.350808 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b863e018-14e8-44e1-b647-a80422ec6933 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e610c10>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:30.398238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b863e018-14e8-44e1-b647-a80422ec6933 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.051524 Oct 15 09:19:30.398932 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1063/2119] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:30 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:31.413649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2d8dc226-f7a1-42b8-9be6-0d06c2aa6501 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85c10>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:31.459231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2d8dc226-f7a1-42b8-9be6-0d06c2aa6501 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049854 Oct 15 09:19:31.459796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1057/2120] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:31 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:32.473927 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-37ee6b1d-60fe-4e0f-a95c-e376a7217106 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8310>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:32.521853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-37ee6b1d-60fe-4e0f-a95c-e376a7217106 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052186 Oct 15 09:19:32.522494 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1064/2121] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:32 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:33.537098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f091d407-28b1-40bc-93e5-3710e9f25c66 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62940>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:33.583307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f091d407-28b1-40bc-93e5-3710e9f25c66 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050578 Oct 15 09:19:33.583863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1058/2122] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:33 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:34.598095 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-92bf94fb-8fd0-41ca-be13-66200bb54ad1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5e2280>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:34.739425 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-92bf94fb-8fd0-41ca-be13-66200bb54ad1 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.145565 Oct 15 09:19:34.739988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1065/2123] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:34 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:35.754829 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-677dd521-ec31-4ccd-b7c1-ed021d573e21 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575ae5e160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:35.800992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-677dd521-ec31-4ccd-b7c1-ed021d573e21 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050388 Oct 15 09:19:35.801551 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1059/2124] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:35 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:36.815683 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-857c9089-3880-43c0-8ed1-1802563f6173 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8a60>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:36.861298 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-857c9089-3880-43c0-8ed1-1802563f6173 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049911 Oct 15 09:19:36.861909 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1066/2125] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:36 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:37.875915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2926a934-ed00-4c1d-8a0f-d6eb20b09a39 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62f70>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:37.921323 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2926a934-ed00-4c1d-8a0f-d6eb20b09a39 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049691 Oct 15 09:19:37.921913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1060/2126] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:37 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:38.936708 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ae8085f7-29b1-4d45-9372-3460b9a0f5cd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e5f5ee0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:38.982359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ae8085f7-29b1-4d45-9372-3460b9a0f5cd tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049929 Oct 15 09:19:38.982910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1067/2127] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:38 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:19:39.996846 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dec186de-9757-4c64-9862-9844dbfab365 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85550>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:40.042052 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dec186de-9757-4c64-9862-9844dbfab365 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050023 Oct 15 09:19:40.042609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1061/2128] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:39 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:41.056670 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fee38713-5b6a-4f86-8cd4-71237ca13d67 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e56c3a0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:41.102652 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fee38713-5b6a-4f86-8cd4-71237ca13d67 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050184 Oct 15 09:19:41.103213 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1068/2129] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:41 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:42.116822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-36b5108e-83eb-4cb7-919e-a49b251e32f3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575c2169d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:42.163077 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-36b5108e-83eb-4cb7-919e-a49b251e32f3 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050571 Oct 15 09:19:42.163639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1062/2130] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:42 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:43.177873 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-042b220d-466b-4c34-b447-697a92ca6aad tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575e6108b0>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:43.224118 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-042b220d-466b-4c34-b447-697a92ca6aad tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050530 Oct 15 09:19:43.224675 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1069/2131] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:43 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:44.239389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9ed55508-bee5-4f85-8d9c-2fec9e71e367 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa85dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:44.284500 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9ed55508-bee5-4f85-8d9c-2fec9e71e367 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049634 Oct 15 09:19:44.285049 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1063/2132] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:44 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:45.298968 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-42930645-d9f5-406a-8173-e36f651aaa36 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aff8310>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:45.344251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-42930645-d9f5-406a-8173-e36f651aaa36 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.049755 Oct 15 09:19:45.344798 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1070/2133] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:45 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:46.359025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-de27ae6b-1a8a-4ba4-a5b8-bd84535cbf78 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aa62dc0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:46.405228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-de27ae6b-1a8a-4ba4-a5b8-bd84535cbf78 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.050519 Oct 15 09:19:46.405827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1064/2134] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:46 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:47.419794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-418b2ea9-d9fa-4de2-ade1-a15587d06800 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575adf2160>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:47.467987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-418b2ea9-d9fa-4de2-ade1-a15587d06800 tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.052682 Oct 15 09:19:47.468552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1071/2135] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:47 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:19:48.483161 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-0024c639-fc36-44d5-bc64-3669071157ac tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] Calling method '.version_select at 0x7f575aed80d0>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:19:48.531941 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-0024c639-fc36-44d5-bc64-3669071157ac tempest-VolumesGetTestJSON-1956440075 tempest-VolumesGetTestJSON-1956440075-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574" status: 200 len: 354 microversion: 2.1 time: 0.053527 Oct 15 09:19:48.532635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1065/2136] 10.222.0.30 () {58 vars in 1245 bytes} [Sat Oct 15 09:19:48 2022] GET /compute/v2.1/os-volumes/0a92163c-0cde-4380-ad0b-8cfddeff9574 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:20:39.380516 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:20:39.381006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:20:39.385621 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1042903446", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "networks": [{"uuid": "e2db0f07-5a2f-4156-9f8d-ab6a97bae24c"}]}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:39.441613 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] validate_networks() for [('e2db0f07-5a2f-4156-9f8d-ab6a97bae24c', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:20:39.837403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Flavor limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:20:39.837855 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Image limits 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:20:39.838315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Flavor pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:20:39.838710 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Image pref 0:0:0 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:20:39.839107 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.virt.hardware [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125327) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:20:39.847878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:39.848346 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:39.848768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:39.849472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:39.849940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:39.850354 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:39.866340 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Getting quotas for project 0c592eb488aa4949a99f2eae3be6b2fa. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:20:39.870216 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Getting quotas for user 529f960930634bc6b0cec7093f0f2e37 and project 0c592eb488aa4949a99f2eae3be6b2fa. Resources: {'ram', 'instances', 'cores'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:20:39.881820 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Going to run 1 instances... {{(pid=125327) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:20:39.884010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125327) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:20:39.931088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e5682aa4-b2b1-4fb9-b39b-31c4e459ed81 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.552284 Oct 15 09:20:39.937224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1072/2137] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 09:20:39.941836 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:20:39.942312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 (ip 10.222.0.30) !!! Oct 15 09:20:39.946009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-500ec81f-2cd2-47ab-9c47-e3ca37dcf32d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:39.946752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-500ec81f-2cd2-47ab-9c47-e3ca37dcf32d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:40.001238 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-500ec81f-2cd2-47ab-9c47-e3ca37dcf32d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:40.008048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-500ec81f-2cd2-47ab-9c47-e3ca37dcf32d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1214 microversion: 2.1 time: 0.068374 Oct 15 09:20:40.008604 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1066/2138] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:39 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:41.030688 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ef14dab3-7670-44b7-9176-de7c94127a4b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:41.031362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ef14dab3-7670-44b7-9176-de7c94127a4b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:41.085591 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ef14dab3-7670-44b7-9176-de7c94127a4b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:41.093032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ef14dab3-7670-44b7-9176-de7c94127a4b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1214 microversion: 2.1 time: 0.066574 Oct 15 09:20:41.093594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1073/2139] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:41 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:42.115193 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6ec28b17-1587-4929-bdf8-6f1928bc89b3 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:42.115809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6ec28b17-1587-4929-bdf8-6f1928bc89b3 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:42.169872 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6ec28b17-1587-4929-bdf8-6f1928bc89b3 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:42.177712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6ec28b17-1587-4929-bdf8-6f1928bc89b3 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1214 microversion: 2.1 time: 0.066243 Oct 15 09:20:42.178365 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1067/2140] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:42 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:43.201092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-d822f3aa-b1d7-4185-b754-2b7775075412 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:43.201713 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-d822f3aa-b1d7-4185-b754-2b7775075412 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:43.257593 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-d822f3aa-b1d7-4185-b754-2b7775075412 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:43.265127 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-d822f3aa-b1d7-4185-b754-2b7775075412 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1214 microversion: 2.1 time: 0.068412 Oct 15 09:20:43.265703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1074/2141] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:43 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:44.288355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:44.288962 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:44.295637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:44.296113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:44.296539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:44.297222 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:44.297667 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:44.298362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:44.362127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:44.376264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-bee8abb8-9802-4721-92e0-754a3d19c79d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1218 microversion: 2.1 time: 0.091643 Oct 15 09:20:44.376841 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1068/2142] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:44 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:45.399838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:45.400513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:45.408279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:45.408761 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:45.409187 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:45.410033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:45.410481 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:45.410902 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:45.476617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:45.484264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-01276636-27fe-42b0-93a3-c81495d06857 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1272 microversion: 2.1 time: 0.088206 Oct 15 09:20:45.484811 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1075/2143] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:45 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:46.507177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:46.507823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:46.515943 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:46.516435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:46.521805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:46.521805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:46.521805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:46.521805 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:46.572872 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24a2c521-d6d8-424c-bbe7-bf3cd53622b0", "tag": "8e2db8b9-5761-4397-a465-30bccabb50dc"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:46.589363 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:46.591046 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:46.591666 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:46.606133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] Creating event network-changed:8e2db8b9-5761-4397-a465-30bccabb50dc for instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 on hv-cinder-85697 Oct 15 09:20:46.611210 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-c4c41027-306b-4f46-b940-05582caa767a req-1d826211-5851-4b46-91cc-17aa1f7dcc52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044996 Oct 15 09:20:46.611978 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1076/2144] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:20:46.802819 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:46.810993 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-022ed917-48ce-4046-8e14-19e6cf1f3476 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1314 microversion: 2.1 time: 0.308221 Oct 15 09:20:46.811567 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1069/2145] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:46 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:47.833537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:47.834264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:47.840586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:47.841617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:47.842072 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:47.842764 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:47.843218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:47.843641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:48.056279 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:48.065049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9b04c573-2d50-4101-b80d-2bdf1d6df40e tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1314 microversion: 2.1 time: 0.235299 Oct 15 09:20:48.065661 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1077/2146] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:47 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:49.087863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:49.088473 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:49.095553 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:49.096028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:49.096460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:49.097135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:49.097608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:49.098059 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:49.347867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:49.355624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fa7b5ed8-2c42-48fd-947a-89fd5ca254f8 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1314 microversion: 2.1 time: 0.271591 Oct 15 09:20:49.356424 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1070/2147] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:49 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:50.378124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:50.378739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:50.381116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:20:50.386468 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:50.386953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:50.387391 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:50.388088 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:50.388543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:50.388966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:50.516315 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:50.523787 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-cdf9bddf-cb3b-4738-91c6-6185f2062f39 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1314 microversion: 2.1 time: 0.149470 Oct 15 09:20:50.524333 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1078/2148] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:50 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:51.028105 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a2c521-d6d8-424c-bbe7-bf3cd53622b0", "name": "network-vif-plugged", "status": "completed", "tag": "8e2db8b9-5761-4397-a465-30bccabb50dc"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:51.038732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:51.039227 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:51.039665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:51.051257 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] Creating event network-vif-plugged:8e2db8b9-5761-4397-a465-30bccabb50dc for instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 on hv-cinder-85697 Oct 15 09:20:51.056152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-a82c8085-b028-49d5-86cf-a751b58b7f9e req-cfa11983-6570-4aef-8cff-84a4cf329977 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Oct 15 09:20:51.056742 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1071/2149] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:20:51.547078 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:51.547626 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:51.554897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:51.555382 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:51.555815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:51.556502 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:51.556959 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:51.557384 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:51.683130 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:51.691257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a05f764f-e1e0-49d1-878b-702fa2f61b8f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1314 microversion: 2.1 time: 0.148605 Oct 15 09:20:51.691817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1079/2150] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:51 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:52.714911 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:52.715583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:52.718009 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=4 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:20:52.723392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:52.723863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:52.724293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:52.724972 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:52.725419 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:52.725867 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:52.851435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:52.859532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fb4d8392-7376-4de5-bf58-d4b8ca97920b tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1498 microversion: 2.1 time: 0.148839 Oct 15 09:20:52.860091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1072/2151] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:52 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:53.258149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:53.258889 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:53.264105 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=10 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:20:53.266087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:53.266566 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:53.266994 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:53.268003 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:53.268456 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:53.268876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:53.295763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:20:53.372027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-202df417-e520-4ba2-8c8b-424dc4db6fde tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "DELETE /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 204 len: 0 microversion: 2.1 time: 0.117378 Oct 15 09:20:53.372686 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1080/2152] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:20:53 2022] DELETE /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:20:53.380760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:53.381379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:53.387781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:53.388275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:53.388730 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:53.389408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:53.389897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:53.390325 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:53.519861 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:53.527548 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fb1a44df-d0f4-4cfd-a03e-bebf32186937 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1504 microversion: 2.1 time: 0.150598 Oct 15 09:20:53.528760 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1073/2153] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:53 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:54.551838 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:54.552540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:54.559077 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:54.559579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:54.560015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:54.560706 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:54.561161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:54.561586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:54.761515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:54.769867 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-74ac0f2e-7f79-49c1-b0cf-e5a7426edce6 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 200 len: 1504 microversion: 2.1 time: 0.222574 Oct 15 09:20:54.770439 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1081/2154] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:54 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:55.127126 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24a2c521-d6d8-424c-bbe7-bf3cd53622b0", "name": "network-vif-deleted", "tag": "8e2db8b9-5761-4397-a465-30bccabb50dc"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:55.139066 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:55.139543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:55.139971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:55.156650 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] Creating event network-vif-deleted:8e2db8b9-5761-4397-a465-30bccabb50dc for instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 on hv-cinder-85697 Oct 15 09:20:55.162190 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-fae78ac2-b41f-45e8-b146-cb9311769f8a req-636d59ec-a33d-4d41-b6c2-753ae69a131e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039151 Oct 15 09:20:55.162801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1074/2155] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:20:55.792459 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:55.793070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 24a2c521-d6d8-424c-bbe7-bf3cd53622b0] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:55.799848 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:55.800323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:55.800756 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:55.801440 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:55.801925 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:55.802376 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:55.815434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] HTTP exception thrown: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Request method failure captured: Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 HTTP/1.1 Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSntlNr2IHRGpHDt3ct0EOJpS6FW4p3Be7_mCLIlb1DN6HTwf0ecslcZ9To8DgBrd3RHHx_Y7yib6u0gkwOlsIKWTmgumuAWhpybj4vBfbI4f-XzDNzN2MEi0ctWm9s5UU69GCINicgCT0AZyw5gYXSeirMDdgIq1ET3z5ZOjJQGSKDo Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 0c592eb488aa4949a99f2eae3be6b2fa Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-VolumesActionsTest-788609453 Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:20:55.817031 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c592eb488aa4949a99f2eae3be6b2fa", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-VolumesActionsTest-788609453 Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 0c592eb488aa4949a99f2eae3be6b2fa Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-VolumesActionsTest-788609453 Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-VolumesActionsTest-788609453-project Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 529f960930634bc6b0cec7093f0f2e37 Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-VolumesActionsTest-788609453-project Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. Oct 15 09:20:55.818540 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '24a2c521-d6d8-424c-bbe7-bf3cd53622b0'} Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:20:55.819302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. Oct 15 09:20:55.820443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:20:55.821408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Returning 404 to user: Instance 24a2c521-d6d8-424c-bbe7-bf3cd53622b0 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:20:55.821408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-363d7476-671b-47df-aa70-5381f32d2783 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0" status: 404 len: 111 microversion: 2.1 time: 0.029777 Oct 15 09:20:55.821408 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1082/2156] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:55 2022] GET /compute/v2.1/servers/24a2c521-d6d8-424c-bbe7-bf3cd53622b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:20:55.868002 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-75781281", "imageRef": "062aaffd-1a10-4115-be0b-2f0e0f9a8f75", "flavorRef": "452", "networks": [{"uuid": "e2db0f07-5a2f-4156-9f8d-ab6a97bae24c"}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:55.920061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] validate_networks() for [('e2db0f07-5a2f-4156-9f8d-ab6a97bae24c', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:20:56.257230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:20:56.257822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:20:56.258146 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:20:56.258547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:20:56.258951 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:20:56.268179 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:56.268653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:56.269080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:56.269835 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:56.270283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:56.270701 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:56.287301 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Getting quotas for project 0c592eb488aa4949a99f2eae3be6b2fa. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:20:56.291138 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Getting quotas for user 529f960930634bc6b0cec7093f0f2e37 and project 0c592eb488aa4949a99f2eae3be6b2fa. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:20:56.302433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:20:56.304762 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='062aaffd-1a10-4115-be0b-2f0e0f9a8f75',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:20:56.349786 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-82825b72-c6da-402e-9d5c-cbda6558d9c0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485816 Oct 15 09:20:56.350422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1075/2157] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 09:20:56.362043 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c8b5230f-c859-4e3d-9866-91a0aff5383f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:56.362650 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c8b5230f-c859-4e3d-9866-91a0aff5383f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:56.414420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c8b5230f-c859-4e3d-9866-91a0aff5383f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:56.421917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c8b5230f-c859-4e3d-9866-91a0aff5383f tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1212 microversion: 2.1 time: 0.063621 Oct 15 09:20:56.422471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1083/2158] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:56 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1212 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:57.445388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:57.446027 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:57.456740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:57.457255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:57.458127 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:57.458822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:57.459269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:57.459709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:57.536463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:57.544117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-93867bf6-83b2-44f2-9cad-3165f4c03036 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1270 microversion: 2.1 time: 0.103112 Oct 15 09:20:57.544687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1076/2159] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:57 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:58.567895 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:58.568510 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:58.576302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:58.576847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:58.577291 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:58.578013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:58.578472 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:58.578898 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:58.612759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1786d4-e26a-49a4-bb32-30f13487113a", "tag": "c382c2ec-eb8c-48db-88a2-ab0f4412a83a"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:20:58.624884 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:58.625358 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:58.625824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:58.638095 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] Creating event network-changed:c382c2ec-eb8c-48db-88a2-ab0f4412a83a for instance 1a1786d4-e26a-49a4-bb32-30f13487113a on hv-cinder-85697 Oct 15 09:20:58.643065 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-c6db7632-cc8a-4dfd-bcc5-67e18c2f64a9 req-d1244f10-5e1b-4161-ac6b-d6d046218802 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035884 Oct 15 09:20:58.643665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1077/2160] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:20:58.843297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:20:58.850901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ec5c76d3-a91e-4332-9f97-d1d3f0cf0f4d tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1312 microversion: 2.1 time: 0.286844 Oct 15 09:20:58.851461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1084/2161] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:58 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:20:59.875266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:20:59.875968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:20:59.882004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:59.882479 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:59.882906 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:20:59.883589 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:20:59.884040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:20:59.884457 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:00.121344 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:00.129532 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1653c23b-15cd-46d6-9d4b-c86e5f2623c2 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1312 microversion: 2.1 time: 0.259459 Oct 15 09:21:00.130216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1078/2162] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:20:59 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1312 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:01.152377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:01.153628 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:01.160306 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:01.160794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:01.161234 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:01.161995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:01.162455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:01.162998 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:01.293913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:01.301804 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3a0d9299-216e-4f32-8528-ccc15c6273e5 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1312 microversion: 2.1 time: 0.153353 Oct 15 09:21:01.302356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1085/2163] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:01 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:02.324268 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:02.324887 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:02.331269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:02.331747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:02.332172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:02.332848 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:02.333292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:02.333722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:02.457980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:02.465937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1e9095ca-7d07-4c87-8088-96f95a790ce0 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1312 microversion: 2.1 time: 0.144948 Oct 15 09:21:02.466747 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1079/2164] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:02 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1312 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:02.928977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1786d4-e26a-49a4-bb32-30f13487113a", "name": "network-vif-plugged", "status": "completed", "tag": "c382c2ec-eb8c-48db-88a2-ab0f4412a83a"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:02.939586 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:02.940133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:02.940579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:02.952128 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] Creating event network-vif-plugged:c382c2ec-eb8c-48db-88a2-ab0f4412a83a for instance 1a1786d4-e26a-49a4-bb32-30f13487113a on hv-cinder-85697 Oct 15 09:21:02.957098 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-873b16d9-3e4b-4a05-83b1-5999f3f129f0 req-a006f58c-1149-4c09-bd54-42502e586099 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 Oct 15 09:21:02.957703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1086/2165] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:21:03.488244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:03.488853 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:03.495460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:03.495953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:03.496420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:03.497773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:03.498350 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:03.498780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:03.628874 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:03.636362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2311ba4f-5623-44fd-afb0-2e6d3a7ac729 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1312 microversion: 2.1 time: 0.151982 Oct 15 09:21:03.636925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1080/2166] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:03 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:04.659397 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:04.660143 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:04.666205 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:04.666684 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:04.667116 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:04.667801 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:04.668264 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:04.669307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:04.796903 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:04.804875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f38763d5-5b38-4177-be4d-169bc4f514ba tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1495 microversion: 2.1 time: 0.150206 Oct 15 09:21:04.805435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1087/2167] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:04 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1495 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:05.228266 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:05.228752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:05.235240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:05.235719 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:05.236149 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:05.236831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:05.237276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:05.237708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:05.263558 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:21:05.340239 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-42ee9c3a-4ef5-4eab-a940-ea253634bb52 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 204 len: 0 microversion: 2.1 time: 0.115183 Oct 15 09:21:05.341415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1081/2168] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:21:05 2022] DELETE /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:21:05.349487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:05.350214 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:05.356021 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:05.356533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:05.356966 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:05.357646 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:05.358119 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:05.358537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:05.488027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:05.495617 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-90ab22ef-6a89-4ee9-bee1-014798c93dcf tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1501 microversion: 2.1 time: 0.149982 Oct 15 09:21:05.496171 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1088/2169] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:05 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:06.519687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:06.520514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:06.522860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:06.523668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:06.529487 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:06.529930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:06.530359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:06.531040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:06.531483 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:06.531905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:06.696488 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '529f960930634bc6b0cec7093f0f2e37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c592eb488aa4949a99f2eae3be6b2fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:06.719159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-50e44f53-8e13-463a-b9cb-f7234a2a83ae tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 200 len: 1501 microversion: 2.1 time: 0.203522 Oct 15 09:21:06.719866 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1082/2170] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:06 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 1501 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:07.102576 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1786d4-e26a-49a4-bb32-30f13487113a", "name": "network-vif-deleted", "tag": "c382c2ec-eb8c-48db-88a2-ab0f4412a83a"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:07.108154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:07.114198 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:07.114607 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:07.115032 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:07.126548 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] Creating event network-vif-deleted:c382c2ec-eb8c-48db-88a2-ab0f4412a83a for instance 1a1786d4-e26a-49a4-bb32-30f13487113a on hv-cinder-85697 Oct 15 09:21:07.131304 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-715e7328-8a84-4ebc-93cc-5ddf326e3aa4 req-9ca24fe4-b8e1-446c-974d-19ecb6025b9a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032482 Oct 15 09:21:07.131885 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1089/2171] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:21:07.742721 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:07.743337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] [instance: 1a1786d4-e26a-49a4-bb32-30f13487113a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:07.750024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:07.750506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:07.750936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:07.751624 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:07.752076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:07.752495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:07.765796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] HTTP exception thrown: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Request method failure captured: Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a HTTP/1.1 Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSntlNr2IHRGpHDt3ct0EOJpS6FW4p3Be7_mCLIlb1DN6HTwf0ecslcZ9To8DgBrd3RHHx_Y7yib6u0gkwOlsIKWTmgumuAWhpybj4vBfbI4f-XzDNzN2MEi0ctWm9s5UU69GCINicgCT0AZyw5gYXSeirMDdgIq1ET3z5ZOjJQGSKDo Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: 0c592eb488aa4949a99f2eae3be6b2fa Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-VolumesActionsTest-788609453 Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:21:07.767417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0c592eb488aa4949a99f2eae3be6b2fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0c592eb488aa4949a99f2eae3be6b2fa", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-VolumesActionsTest-788609453 Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: 0c592eb488aa4949a99f2eae3be6b2fa Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-VolumesActionsTest-788609453 Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-VolumesActionsTest-788609453-project Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 529f960930634bc6b0cec7093f0f2e37 Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-VolumesActionsTest-788609453-project Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. Oct 15 09:21:07.768931 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '1a1786d4-e26a-49a4-bb32-30f13487113a'} Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:21:07.769830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. Oct 15 09:21:07.771277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:07.772494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] Returning 404 to user: Instance 1a1786d4-e26a-49a4-bb32-30f13487113a could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:21:07.772494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-83ae7c09-444e-480e-b951-6bea94ec64e4 tempest-VolumesActionsTest-788609453 tempest-VolumesActionsTest-788609453-project] 10.222.0.30 "GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a" status: 404 len: 111 microversion: 2.1 time: 0.029837 Oct 15 09:21:07.772494 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1083/2172] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:07 2022] GET /compute/v2.1/servers/1a1786d4-e26a-49a4-bb32-30f13487113a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:21:14.229664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:14.230220 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:14.236465 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:14.238549 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:14.239341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:14.239956 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:14.240825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:14.241430 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:14.242026 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:14.245435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:14.272094 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lazy-loading 'flavor' on Instance uuid af728b0d-0245-45ce-b3d9-4d25dc6632be {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:21:14.354679 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9d2706a6-8209-4ec5-9b39-bb97885ab417 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "POST /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be/action" status: 202 len: 0 microversion: 2.1 time: 0.129729 Oct 15 09:21:14.355541 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1090/2173] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 09:21:14 2022] POST /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:21:14.377134 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:14.380262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:14.397714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:14.409507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:14.410159 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:14.410968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:14.411653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:14.412114 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:14.412539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:14.438005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:14.585201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:14.594163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-d779b65b-d1b0-4e5d-a055-d7b45663819a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.232903 Oct 15 09:21:14.613770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1084/2174] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:14 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:15.618370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:15.619056 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:15.625971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:15.626457 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:15.626893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:15.627584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:15.628034 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:15.628451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:15.780910 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:15.792071 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c4dadf8f-6f30-4610-98db-fdcdd51dd1b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.177736 Oct 15 09:21:15.792947 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1091/2175] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:15 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:16.821849 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:16.822460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:16.829593 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:16.830109 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:16.830536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:16.831458 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:16.831925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:16.832372 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:16.984837 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:16.993133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4795919b-1de2-4176-b53a-8fb6bd50867c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.175215 Oct 15 09:21:17.001622 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1085/2176] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:16 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:18.016893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:18.017506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:18.024517 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:18.025006 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:18.025438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:18.026421 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:18.026953 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:18.027451 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:18.168317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:18.179614 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b283f725-3de8-4b60-9334-b04543f91a1e tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.166971 Oct 15 09:21:18.180536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1092/2177] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:18 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:19.211420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:19.212942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:19.220997 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:19.221472 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:19.221937 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:19.223035 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:19.223665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:19.224091 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:19.405237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:19.414648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-ef3e3268-99e2-4af7-a4ea-119d5afa8c98 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.208163 Oct 15 09:21:19.415636 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1086/2178] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:19 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:20.441536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:20.443089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:20.459765 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:20.460374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:20.460920 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:20.461740 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:20.462208 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:20.462641 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:20.607182 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:20.626620 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7ab95273-3670-42f4-9d55-b36f01d85439 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.188710 Oct 15 09:21:20.627571 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1093/2179] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:20 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:21.661110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:21.662415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:21.669485 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:21.670754 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:21.671416 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:21.672318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:21.672969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:21.673588 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:21.826612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:21.835495 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-23cb9366-d86e-497c-9597-753c30f55943 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.178046 Oct 15 09:21:21.836163 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1087/2180] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:21 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:22.859644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:22.860246 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:22.867360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:22.867833 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:22.868428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:22.869111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:22.869558 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:22.870001 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:23.011217 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:23.022638 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1fb3c7e2-6573-4982-9c70-bf997ed1ec1f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.166934 Oct 15 09:21:23.023865 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1094/2181] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:22 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:24.045335 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:24.046206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:24.054370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:24.054886 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:24.055328 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:24.056090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:24.056555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:24.057164 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:24.225254 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:24.237342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-a8449eea-e6f3-4289-9555-9b802b81a2aa tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.195652 Oct 15 09:21:24.239255 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1088/2182] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:24 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:25.261776 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:25.262536 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:25.269874 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:25.270635 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:25.271133 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:25.271827 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:25.272277 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:25.272839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:25.417634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:25.426565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-27995c2b-7bcf-4ec0-b74a-58621ea7b4c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.168575 Oct 15 09:21:25.427148 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1095/2183] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:25 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:26.451128 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:26.452231 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:26.458957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:26.459449 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:26.459880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:26.460584 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:26.461039 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:26.461686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:26.635304 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:26.648815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-349f4473-81c6-4f08-a9d6-2de0d1d95a45 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.201854 Oct 15 09:21:26.649905 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1089/2184] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:26 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:27.673775 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:27.674643 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:27.677135 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:21:27.677280 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:21:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be (ip 10.222.0.30) !!! Oct 15 09:21:27.688358 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.688826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.689251 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:27.689965 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.690412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.690825 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:27.821204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:27.828893 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-24c7524d-b2cb-4cf5-b46c-aad979d149a4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1512 microversion: 2.1 time: 0.159374 Oct 15 09:21:27.829448 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1096/2185] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:27 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:27.851614 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:27.852217 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:27.859379 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.859797 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.860229 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:27.860916 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.861370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.861826 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:27.901143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125329) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 15 09:21:27.972901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-abc3de31-0156-48f5-9e7b-19451a302458 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "POST /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be/action" status: 202 len: 0 microversion: 2.1 time: 0.125115 Oct 15 09:21:27.973716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1090/2186] 10.222.0.30 () {60 vars in 1278 bytes} [Sat Oct 15 09:21:27 2022] POST /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:21:27.981409 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:27.982114 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:27.988307 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.988859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.989374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:27.990138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:27.990655 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:27.991142 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:28.133933 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:28.143012 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e97984f4-9353-4670-8adc-e06117f543ca tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1520 microversion: 2.1 time: 0.165283 Oct 15 09:21:28.143792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1097/2187] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:27 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:29.167935 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:29.168779 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:29.176275 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:29.176761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:29.177279 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:29.177991 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:29.178832 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:29.179272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:29.325859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:29.334781 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3e51d878-fb48-4813-a69f-fb99b43c3231 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1522 microversion: 2.1 time: 0.170975 Oct 15 09:21:29.335462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1091/2188] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:29 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:29.440120 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "name": "network-vif-unplugged", "status": "completed", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:29.450335 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:29.451338 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:29.451772 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:29.463744 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] Creating event network-vif-unplugged:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:21:29.470250 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-48d51304-8ae1-4a0f-971d-b34c4c822c65 req-61ef48ad-1045-4e40-8e96-7a6f3cddeaa5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033780 Oct 15 09:21:29.470842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1098/2189] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:21:30.358949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:30.359555 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:30.365873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:30.366368 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:30.366783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:30.367466 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:30.367921 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:30.368321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:30.523427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:30.532037 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-4d1ef449-b132-41ca-9897-71b22ec0663d tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.177051 Oct 15 09:21:30.532647 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1092/2190] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:30 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:31.555859 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:31.556554 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:31.562847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:31.563321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:31.563749 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:31.564427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:31.564876 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:31.565297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:31.691253 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:31.698989 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-c8f4b707-2ac0-4725-897e-f3929b9911ff tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.147789 Oct 15 09:21:31.699543 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1099/2191] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:31 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:32.722823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:32.723434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:32.729823 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:32.730302 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:32.730736 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:32.731417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:32.731915 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:32.732337 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:32.866038 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:32.874276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-de58259d-0bb0-4563-8b9d-abaf2cbebec4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.155399 Oct 15 09:21:32.874834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1093/2192] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:32 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:21:33.897711 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:33.898316 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:33.904847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:33.905347 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:33.905809 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:33.906496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:33.906976 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:33.907426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:34.035519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:34.043375 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-7df733a1-6687-4303-9eb1-65e874a040b3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.149553 Oct 15 09:21:34.043923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1100/2193] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:33 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:35.066639 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:35.067249 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:35.073957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:35.074432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:35.074859 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:35.075590 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:35.076040 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:35.076460 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:35.205191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:35.212791 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f1eb3088-10f0-4f6b-9d6d-6cb58a91d25f tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.150047 Oct 15 09:21:35.213550 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1094/2194] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:35 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:36.237336 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:36.238428 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:36.244446 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:36.244924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:36.245350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:36.246070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:36.246537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:36.246957 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:36.380190 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:36.388578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5ad3825f-13dd-4122-81d4-07eceac828d4 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.154622 Oct 15 09:21:36.389138 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1101/2195] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:36 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:37.412110 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:37.412707 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:37.418583 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:37.419061 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:37.419486 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:37.420165 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:37.420609 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:37.421024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:37.549492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:37.557186 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5bbf5cc4-912c-49be-80f1-61d3fcc43fa5 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.149004 Oct 15 09:21:37.557783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1095/2196] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:37 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:38.582378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:38.583028 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:38.589526 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:38.590038 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:38.590475 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:38.591781 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:38.592238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:38.592664 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:38.724826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:38.732946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-50939503-40eb-4460-ae6a-0d53b6d76d5a tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.154338 Oct 15 09:21:38.733513 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1102/2197] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:38 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:39.527230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "name": "network-vif-plugged", "status": "completed", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:21:39.538285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:39.538842 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:39.539307 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:39.552321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] Creating event network-vif-plugged:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:21:39.557436 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-a4ef6891-85f3-429d-9dad-9bba83ff85cd req-496e60b1-6ef3-4555-ae23-d68de4c9ed2a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033815 Oct 15 09:21:39.558083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1096/2198] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:21:39.755619 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:39.756212 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:39.762535 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:39.763035 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:39.763461 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:39.764153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:39.764606 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:39.765030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:39.902794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:39.911049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-583d2aa0-d12c-4751-9c7b-639f2cb201c8 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1578 microversion: 2.1 time: 0.159411 Oct 15 09:21:39.911609 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1103/2199] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:39 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:21:40.935930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:40.936631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:40.943338 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:40.943773 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:40.944205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:40.944889 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:40.945342 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:40.945801 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:41.080831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:21:41.088598 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f13d9230-a19b-4d33-bb6b-b0999d09524c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1565 microversion: 2.1 time: 0.157516 Oct 15 09:21:41.089172 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1097/2200] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:40 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:21:49.001703 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:49.002203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:49.004788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=28 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:49.010099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:49.010574 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:49.011004 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:49.011687 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:49.012134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:49.013124 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:49.015737 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:49.028022 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f HTTP/1.1 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:21:49.030379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.031880 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': 'd591419c-18a4-4e6b-a087-d9a2b4edaf8f'} Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:21:49.032663 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.034050 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.035629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:21:49.035629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-f8ccf171-3030-4859-8fed-c79b1fa11711 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 404 len: 111 microversion: 2.1 time: 0.033821 Oct 15 09:21:49.035629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1104/2201] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:21:48 2022] DELETE /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:21:49.040063 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:49.040681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: d591419c-18a4-4e6b-a087-d9a2b4edaf8f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:49.043244 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:49.049102 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:49.049881 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:49.050321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:49.051050 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:49.051507 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:49.051963 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:49.055106 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:21:49.067518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f HTTP/1.1 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:21:49.069154 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.070666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': 'd591419c-18a4-4e6b-a087-d9a2b4edaf8f'} Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:21:49.071514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. Oct 15 09:21:49.072668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:49.073722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance d591419c-18a4-4e6b-a087-d9a2b4edaf8f could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:21:49.073722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c3a80692-316d-4f71-8d93-1253b87aab6d tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f" status: 404 len: 111 microversion: 2.1 time: 0.034227 Oct 15 09:21:49.073722 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1098/2202] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:49 2022] GET /compute/v2.1/servers/d591419c-18a4-4e6b-a087-d9a2b4edaf8f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:21:50.206985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:50.207490 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:50.213963 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:50.214445 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:50.214878 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:50.215562 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:50.216527 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:50.216950 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:50.230232 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: DELETE /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f HTTP/1.1 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:21:50.232386 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.233856 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '28480cd2-5ae8-4292-9c17-be983439b53f'} Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:21:50.234767 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.236193 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.237693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:21:50.237693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-5a4b3b40-7aaa-4fa8-a4a4-8ab5ec3f7783 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "DELETE /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 404 len: 111 microversion: 2.1 time: 0.030890 Oct 15 09:21:50.237693 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1105/2203] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:21:50 2022] DELETE /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:21:50.242434 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:21:50.243058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] [instance: 28480cd2-5ae8-4292-9c17-be983439b53f] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:21:50.249699 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:50.250191 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:50.250630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:50.251317 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:21:50.251772 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:21:50.252195 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:21:50.265390 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] HTTP exception thrown: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Request method failure captured: Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f HTTP/1.1 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnL96mPTZGyuV_5jNGjalpRNluP-HVfOOOTEkVuSUAb6Ut3_aXannfN_myS0q_uaBI9vwNkwM8aR8VDBJrQ0pXJElwhNxnBwKwUkF7BhTP0IXRV2zMPcSKZovXEboFvslA1yA6GetOxR5Cenyid5WaSgxvV_vN6ZkNtexu88dYCS8mk Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:21:50.266932 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ca38c1109acc49849daeb555b673e756"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ca38c1109acc49849daeb555b673e756"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ca38c1109acc49849daeb555b673e756", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: ca38c1109acc49849daeb555b673e756 Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-778340715 Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 060d1fae9b0b488da1f7553cabd97d28 Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeNegativeTest-778340715-project Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.268352 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '28480cd2-5ae8-4292-9c17-be983439b53f'} Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:21:50.269075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. Oct 15 09:21:50.270207 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:21:50.271176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] Returning 404 to user: Instance 28480cd2-5ae8-4292-9c17-be983439b53f could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:21:50.271176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-081a0006-a7b1-4976-8f6d-5171c6c12d32 tempest-AttachVolumeNegativeTest-778340715 tempest-AttachVolumeNegativeTest-778340715-project] 10.222.0.30 "GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f" status: 404 len: 111 microversion: 2.1 time: 0.030040 Oct 15 09:21:50.271176 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1099/2204] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:21:50 2022] GET /compute/v2.1/servers/28480cd2-5ae8-4292-9c17-be983439b53f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:22:55.248967 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:22:55.249533 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:22:55.252204 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:22:55.252674 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:22:55.253134 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=3 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:22:55.254148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:22:55.270486 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:55.270982 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:55.271420 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:55.272129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:55.272590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:55.273201 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:55.301573 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Going to try to terminate instance {{(pid=125327) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:22:55.388899 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ea767980-7e51-411c-98ec-cea67fac2120 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "DELETE /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 204 len: 0 microversion: 2.1 time: 0.144617 Oct 15 09:22:55.393595 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1106/2205] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:22:55 2022] DELETE /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:22:55.399747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:22:55.401099 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:22:55.407523 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:55.408197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:55.408815 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:55.409719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:55.410285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:22:55.410438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:55.410728 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:55.420705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:55.421623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:55.422213 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:55.434770 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] Creating event network-changed:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:22:55.440665 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-f4df4e45-0f62-4e22-8580-ee0b4578601e req-85ad7460-b601-4962-b292-7e79ae12f6fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194383 Oct 15 09:22:55.441608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1100/2206] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:22:55.542434 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:22:55.551891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2907b2dd-5512-4bb8-9fea-3132e9b3a724 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.156683 Oct 15 09:22:55.553211 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1107/2207] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:22:55 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:22:56.576752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:22:56.577521 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:22:56.586023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:56.586560 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:56.587003 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:56.587708 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:56.588168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:56.588633 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:56.719713 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:22:56.727983 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b8d933ea-dd3b-4604-b922-1bcd2da82df3 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.155318 Oct 15 09:22:56.728556 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1101/2208] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:22:56 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:22:57.752429 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:22:57.753058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:22:57.759552 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:57.760030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:57.760462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:57.761145 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:57.761600 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:57.762054 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:57.887729 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:22:57.895528 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-21184d0c-d97e-4042-977d-857f6063d08b tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.147495 Oct 15 09:22:57.896084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1108/2209] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:22:57 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:22:58.918740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:22:58.919243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:22:58.926478 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:58.926949 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:58.927370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:58.928046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:22:58.928492 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:22:58.928909 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:22:59.141409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:22:59.149380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-9d5c983b-4a30-42b7-8b7e-1fb00c4f0e39 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1571 microversion: 2.1 time: 0.234535 Oct 15 09:22:59.150018 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1102/2210] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:22:58 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1571 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:00.051030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af728b0d-0245-45ce-b3d9-4d25dc6632be", "name": "network-vif-deleted", "tag": "3a4413b9-823f-490c-8e7b-3ab870215bf0"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:00.061000 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:00.061471 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:00.061923 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:00.084233 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] Creating event network-vif-deleted:3a4413b9-823f-490c-8e7b-3ab870215bf0 for instance af728b0d-0245-45ce-b3d9-4d25dc6632be on hv-cinder-85697 Oct 15 09:23:00.088487 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-57485766-87c4-40b5-84f5-cb90d3f1de15 req-a3deba86-a952-41d4-a4e7-129ff6c90c57 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041219 Oct 15 09:23:00.089374 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1109/2211] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:23:00.174957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:00.175830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:00.182645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:00.183119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:00.183545 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:00.184318 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:00.184769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:00.185182 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:00.267162 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:00.276234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-86c5e7ba-f31d-4129-b745-45acbc21cb74 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1220 microversion: 2.1 time: 0.105168 Oct 15 09:23:00.276796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1103/2212] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:00 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:01.301455 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:01.302178 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:01.308281 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:01.308757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:01.309186 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:01.309888 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:01.310350 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:01.310762 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:01.344317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:01.344831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:01.345263 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:01.345721 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.objects.instance [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lazy-loading 'fault' on Instance uuid af728b0d-0245-45ce-b3d9-4d25dc6632be {{(pid=125327) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:23:01.385651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:01.394089 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-1ee11b79-8b1f-4f92-abfb-fe8652fd8e41 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1225 microversion: 2.1 time: 0.096910 Oct 15 09:23:01.394662 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1110/2213] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:01 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:02.416262 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:02.416878 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:02.423245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:02.423716 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:02.424143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:02.424843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:02.425289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:02.426004 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:02.455272 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:02.456369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:02.456796 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:02.457490 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lazy-loading 'fault' on Instance uuid af728b0d-0245-45ce-b3d9-4d25dc6632be {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:23:02.496388 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '440ce33b27fa46f6aaeab9184d8ef5a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c1e74e55af54016b9e63666c1594675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:02.503957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-14e0f015-3519-4c1b-a329-c1cd9d00c9c2 tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 200 len: 1225 microversion: 2.1 time: 0.091571 Oct 15 09:23:02.504506 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1104/2214] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:02 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:03.527111 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:03.527726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] [instance: af728b0d-0245-45ce-b3d9-4d25dc6632be] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:03.534161 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:03.534644 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:03.535080 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:03.535768 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:03.536224 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:03.536651 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:03.550322 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] HTTP exception thrown: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Request method failure captured: Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be HTTP/1.1 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnrwRDJuLBOn5r4WwhlOBc9adkjpGwcuslObtHtp0L1jS_H3-moL3g2AnoHSBUd5cKrCksNpGwOZ3eNXNZMtH6G6P9HjcsjmAldmmE6o0KTXPYxuejKbBYpTE5jQkH-7DIxUWsxCm4p0yN1mXSz5vA42vOZpuKkuwtQK5mJxQ0bshwI Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: 6c1e74e55af54016b9e63666c1594675 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-TestShelveInstance-1155838369 Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:23:03.552266 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c1e74e55af54016b9e63666c1594675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/6c1e74e55af54016b9e63666c1594675"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/6c1e74e55af54016b9e63666c1594675"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_6c1e74e55af54016b9e63666c1594675", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-TestShelveInstance-1155838369 Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: 6c1e74e55af54016b9e63666c1594675 Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-TestShelveInstance-1155838369 Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-TestShelveInstance-1155838369-project Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 440ce33b27fa46f6aaeab9184d8ef5a3 Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-TestShelveInstance-1155838369-project Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. Oct 15 09:23:03.553891 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': 'af728b0d-0245-45ce-b3d9-4d25dc6632be'} Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:23:03.554847 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. Oct 15 09:23:03.556297 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:23:03.557788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Returning 404 to user: Instance af728b0d-0245-45ce-b3d9-4d25dc6632be could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:23:03.557788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a461489c-4e73-464b-83d2-a264b6702b4c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be" status: 404 len: 111 microversion: 2.1 time: 0.030317 Oct 15 09:23:03.557788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1111/2215] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:03 2022] GET /compute/v2.1/servers/af728b0d-0245-45ce-b3d9-4d25dc6632be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:23:03.713968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-e1580cc2-2871-4dfc-b6f0-671537ca704c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] Calling method '.version_select at 0x7f575aa62670>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:03.740206 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-e1580cc2-2871-4dfc-b6f0-671537ca704c tempest-TestShelveInstance-1155838369 tempest-TestShelveInstance-1155838369-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2107611068" status: 202 len: 0 microversion: 2.1 time: 0.030090 Oct 15 09:23:03.740850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1105/2216] 10.222.0.30 () {58 vars in 1254 bytes} [Sat Oct 15 09:23:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2107611068 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 15 09:23:23.143356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:23.144091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:23.309579 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2477d8b6-f6e3-413b-b758-85358273f0c1 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Action: 'create', calling method: .version_select at 0x7f575ae43c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1090915854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLlFFtvfHXK+fBsn8WsbrR3ZWN7cVrH0mZ7af5hORP38NdO79jp0tZV6QPYqKIRk1ePaoUgyJZCEaGkBs3Q3pIvEnb3vo8qdtUia7nuzBt5xd5BYEv5AvrqG/Tv+7Cnnmw=="}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:23.326102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-2477d8b6-f6e3-413b-b758-85358273f0c1 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for project c6262387226346b7a736e34171afb4de. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:23:23.330117 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.quota [None req-2477d8b6-f6e3-413b-b758-85358273f0c1 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for user 04b8dc0532de441db59bd4fe465a8c0a and project c6262387226346b7a736e34171afb4de. Resources: {'key_pairs'} {{(pid=125327) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:23:23.355537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2477d8b6-f6e3-413b-b758-85358273f0c1 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.217393 Oct 15 09:23:23.356126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1112/2217] 10.222.0.30 () {60 vars in 1159 bytes} [Sat Oct 15 09:23:23 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:23:39.636320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1512920775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1090915854", "security_groups": [{"name": "tempest-secgroup-smoke-248103280"}], "block_device_mapping_v2": [{"uuid": "03f2d619-848e-48cd-8359-505a0e8fc73e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccfbd7a-0c01-414f-bb39-7396d65ae598"}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:39.647746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=28 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:39.648381 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:39.751292 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] validate_networks() for [('9ccfbd7a-0c01-414f-bb39-7396d65ae598', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:23:40.119355 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:23:40.119766 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:23:40.120228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:23:40.120625 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:23:40.121025 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:23:40.130069 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:40.130539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:40.130969 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:40.132234 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:40.132681 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:40.133099 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:40.149890 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for project c6262387226346b7a736e34171afb4de. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:23:40.153870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for user 04b8dc0532de441db59bd4fe465a8c0a and project c6262387226346b7a736e34171afb4de. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:23:40.208653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:23:40.211432 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03f2d619-848e-48cd-8359-505a0e8fc73e',volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:23:40.336228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [6810e88e-90be-408b-91cb-6e5460c1e935] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 09:23:41.343282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [6810e88e-90be-408b-91cb-6e5460c1e935] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 59490. Oct 15 09:23:41.347543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-92541236-751d-4c18-8fec-24e8fbf64866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.715326 Oct 15 09:23:41.348189 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1106/2218] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:23:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 15 09:23:41.357149 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=4 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:41.357917 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:41.361800 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-844b4da6-c697-4799-b84a-f5b4c0f3265d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:41.362480 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-844b4da6-c697-4799-b84a-f5b4c0f3265d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:41.421087 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-844b4da6-c697-4799-b84a-f5b4c0f3265d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:41.428238 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-844b4da6-c697-4799-b84a-f5b4c0f3265d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1095 microversion: 2.1 time: 0.072408 Oct 15 09:23:41.428973 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1113/2219] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:41 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:42.451652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:42.452380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:42.458392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:42.458880 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:42.459930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:42.461216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:42.461698 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:42.462152 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:42.528435 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:42.536642 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cb3165ae-80ca-4517-94c2-eb7df8160689 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1201 microversion: 2.1 time: 0.089275 Oct 15 09:23:42.537216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1107/2220] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:42 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:43.559752 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:43.560356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:43.567058 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:43.567629 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:43.568126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:43.568879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:43.569879 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:43.570267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:43.705356 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:43.714027 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-69701e3e-05cc-4bda-bae2-a29da6b38d6c tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.158117 Oct 15 09:23:43.714590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1114/2221] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:43 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:43.912787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c28f5c-204f-49b4-8b24-8630fce690f6", "tag": "6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:43.923086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:43.923864 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:43.924359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:43.936133 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] Creating event network-changed:6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c for instance 19c28f5c-204f-49b4-8b24-8630fce690f6 on hv-cinder-85697 Oct 15 09:23:43.941169 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-4062b4fb-f8c2-4246-bd25-4846a547f86e req-f229f8fa-e67b-4416-ae98-07a1ef557f6b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032401 Oct 15 09:23:43.941783 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1108/2222] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:23:44.737240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:44.738033 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:44.744987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:44.745578 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:44.746109 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:44.746883 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:44.747412 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:44.747905 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:44.883070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:44.891274 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-a7f1b527-5c87-4336-be0c-211c26ff792f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.157857 Oct 15 09:23:44.891915 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1115/2223] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:44 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:45.915284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:45.915978 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:45.922115 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:45.922528 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:45.922958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:45.923632 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:45.924080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:45.924496 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:46.053831 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:46.061439 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c649f939-4ff3-4754-833f-f82e8bd2fae3 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.151406 Oct 15 09:23:46.062041 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1109/2224] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:45 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:47.084184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:47.084788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:47.091701 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:47.092172 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:47.092594 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:47.093270 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:47.093735 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:47.094153 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:47.223348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:47.230900 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-9b605c4e-931b-4fe9-9ec9-79e752d61930 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.150550 Oct 15 09:23:47.231449 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1116/2225] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:47 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:48.253649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:48.254285 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:48.261125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:48.261603 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:48.262068 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:48.262746 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:48.263200 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:48.263620 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:48.391670 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:48.400088 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-98c5dba1-6064-4b21-b333-f71371a416a6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.150277 Oct 15 09:23:48.400987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1110/2226] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:48 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:49.422364 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:49.422977 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:49.430163 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:49.430645 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:49.431084 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:49.431770 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:49.432221 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:49.432647 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:49.563506 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:49.571993 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fc365854-ea5c-4e7a-8053-dc9d79dbb89d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.153477 Oct 15 09:23:49.572561 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1117/2227] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:49 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:50.594631 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:50.595240 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:50.597664 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:50.598341 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:50.603818 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:50.604289 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:50.604715 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:50.605420 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:50.605899 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:50.606321 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:50.732703 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:50.740310 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fe8bb06e-ed0b-4b9b-a1ff-91f4ca43d3c4 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.149514 Oct 15 09:23:50.740871 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1111/2228] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:50 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:51.762924 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:51.763634 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:51.765942 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:23:51.771261 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:51.771732 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:51.772159 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:51.773345 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:51.773817 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:51.774236 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:51.904806 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:51.912395 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-80f63a27-de03-40c6-be15-e2d99e7da401 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.153296 Oct 15 09:23:51.912961 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1118/2229] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:51 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:52.936013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:52.936626 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:52.943017 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:52.943493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:52.943926 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:52.944641 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:52.945073 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:52.945512 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:53.075989 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:53.083749 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-95a289ca-694c-408a-90d2-c36f07369094 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.151711 Oct 15 09:23:53.084320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1112/2230] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:52 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:54.106136 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:54.106746 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:54.115370 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:54.115853 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:54.116831 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:54.117748 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:54.118379 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:54.118797 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:54.203391 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c28f5c-204f-49b4-8b24-8630fce690f6", "name": "network-vif-plugged", "status": "completed", "tag": "6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:54.213276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:54.213798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:54.214230 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:54.225356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] Creating event network-vif-plugged:6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c for instance 19c28f5c-204f-49b4-8b24-8630fce690f6 on hv-cinder-85697 Oct 15 09:23:54.230782 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-f088994f-6100-4fc6-9325-6c32a570399e req-11b0b585-3ee2-4e19-9fa3-b49c6496f1d2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123840 Oct 15 09:23:54.231568 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1113/2231] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:23:54.257611 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:54.265515 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e9a59e9d-ceae-4a79-be18-572eb6d49742 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.163181 Oct 15 09:23:54.266112 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1119/2232] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:54 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:55.288393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:55.289086 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:55.295216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:55.295690 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:55.296117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:55.296794 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:55.297243 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:55.297662 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:55.434676 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:55.442417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-2ce08115-222d-4a7e-a221-1e9dbbab8ccf tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1266 microversion: 2.1 time: 0.158620 Oct 15 09:23:55.443129 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1114/2233] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:55 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:56.466739 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:56.467348 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:56.473788 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:56.474267 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:56.474696 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:56.475378 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:56.476438 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:56.476863 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:56.604091 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:56.611757 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-81a1c53b-083c-44bf-a9a7-53e3cc95e643 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1452 microversion: 2.1 time: 0.148871 Oct 15 09:23:56.612320 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1120/2234] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:56 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:56.633834 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:23:56.634448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:23:56.640787 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:56.641269 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:56.641723 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:56.642408 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:56.642860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:56.643284 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:56.775843 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:23:56.783426 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3b0399bf-d0ee-4b9a-b5df-cac8b383c581 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1452 microversion: 2.1 time: 0.154060 Oct 15 09:23:56.783992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1115/2235] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:23:56 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:23:58.427780 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c28f5c-204f-49b4-8b24-8630fce690f6", "tag": "6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:23:58.438393 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:23:58.438869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:23:58.439296 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:23:58.453904 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] Creating event network-changed:6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c for instance 19c28f5c-204f-49b4-8b24-8630fce690f6 on hv-cinder-85697 Oct 15 09:23:58.459769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-0769cf25-a479-4912-9e91-435e0ed7042d req-b9dc4ac7-38af-442c-a6ab-1b7b7c553a50 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035148 Oct 15 09:23:58.461122 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1121/2236] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:24:19.775612 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:24:19.776143 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:24:19.778209 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:24:19.778858 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=48 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:24:19.784671 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:24:19.785145 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:24:19.785570 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:24:19.786277 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:24:19.786739 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:24:19.787142 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:24:19.802942 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] HTTP exception thrown: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Request method failure captured: Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a HTTP/1.1 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnLwXVVkv1nzE-jqS8HlrNyMk8rUR1QXUT8zeGYwAkrKG_ciCR0vYj2YifX_04EwKPHXoPeXCCJ9f8o8V9NrmgVVwazAA2Fd2jMKRLHWXrJxSJmstRH5nE1AEaSA2F3rXh25wFM9QshyOl0j7GknzwnNukx6ObEJiCW3VT-Lh7sGFbU Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:24:19.804605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/becb9cd46453447a87846cf26561a190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_becb9cd46453447a87846cf26561a190", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: a5d85f7efca040cc81253dfbf0de7c42 Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.806210 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '42fe6c8c-4787-4c73-8993-3bcb42cf1e4a'} Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:24:19.807205 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.808788 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.810370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Returning 404 to user: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:24:19.810370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1d6df010-5c0b-4119-9810-281b37b44954 tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 404 len: 111 microversion: 2.1 time: 0.034951 Oct 15 09:24:19.810370 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1116/2237] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:24:19 2022] DELETE /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:24:19.812341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=20 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:24:19.813079 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=44 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:24:19.817258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:24:19.817980 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] [instance: 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:24:19.825206 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:24:19.825719 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:24:19.826150 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:24:19.826826 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:24:19.827300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:24:19.827717 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:24:19.841184 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] HTTP exception thrown: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Request method failure captured: Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a HTTP/1.1 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnLwXVVkv1nzE-jqS8HlrNyMk8rUR1QXUT8zeGYwAkrKG_ciCR0vYj2YifX_04EwKPHXoPeXCCJ9f8o8V9NrmgVVwazAA2Fd2jMKRLHWXrJxSJmstRH5nE1AEaSA2F3rXh25wFM9QshyOl0j7GknzwnNukx6ObEJiCW3VT-Lh7sGFbU Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:24:19.842782 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/becb9cd46453447a87846cf26561a190"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/becb9cd46453447a87846cf26561a190"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_becb9cd46453447a87846cf26561a190", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: becb9cd46453447a87846cf26561a190 Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-AttachVolumeTestJSON-297522293 Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: a5d85f7efca040cc81253dfbf0de7c42 Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-AttachVolumeTestJSON-297522293-project Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.844257 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '42fe6c8c-4787-4c73-8993-3bcb42cf1e4a'} Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:24:19.845323 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. Oct 15 09:24:19.846842 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:24:19.848191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] Returning 404 to user: Instance 42fe6c8c-4787-4c73-8993-3bcb42cf1e4a could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:24:19.848191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-fe9a4d58-99d6-41e3-938c-4622640b0c2f tempest-AttachVolumeTestJSON-297522293 tempest-AttachVolumeTestJSON-297522293-project] 10.222.0.30 "GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a" status: 404 len: 111 microversion: 2.1 time: 0.033453 Oct 15 09:24:19.848191 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1122/2238] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:24:19 2022] GET /compute/v2.1/servers/42fe6c8c-4787-4c73-8993-3bcb42cf1e4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:25:53.551021 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b36a50e-0270-4e32-8c64-cc741e9e62cd] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 09:25:53.551537 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:25:53.552232 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:25:53.554064 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:25:53.554204 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 (ip 10.222.0.30) !!! Oct 15 09:25:53.559264 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:53.559753 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:53.568156 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:53.568630 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:53.569058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:53.569767 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:53.570219 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:53.570637 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:53.596322 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:25:53.669147 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-479a20a1-ad52-4cae-99bd-8b3bae62b2aa tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 204 len: 0 microversion: 2.1 time: 0.119837 Oct 15 09:25:53.669652 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1117/2239] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:25:53 2022] DELETE /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:25:53.676108 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:25:53.676997 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:25:53.677816 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:25:53.677988 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 (ip 10.222.0.30) !!! Oct 15 09:25:53.679987 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:25:53.680154 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:25:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 (ip 10.222.0.30) !!! Oct 15 09:25:53.685271 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:53.685913 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:53.695462 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:53.695945 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:53.696380 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:53.697066 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:53.697519 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:53.697971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:54.127243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:25:54.135240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-0f042540-c928-4e88-a198-994983e2a855 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1576 microversion: 2.1 time: 0.460760 Oct 15 09:25:54.135789 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1123/2240] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:53 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1576 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:25:55.160443 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:55.161083 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:55.174283 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b36a50e-0270-4e32-8c64-cc741e9e62cd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60644. Oct 15 09:25:55.176271 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:55.176740 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:55.177167 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:55.177897 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:55.178349 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:55.179028 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:55.359802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:25:55.368236 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-cd8a2d8b-79c4-481a-9358-d4060f0a8467 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1576 microversion: 2.1 time: 0.212909 Oct 15 09:25:55.368802 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1118/2241] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:55 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:25:56.379140 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c28f5c-204f-49b4-8b24-8630fce690f6", "name": "network-vif-deleted", "tag": "6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c"}]} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:25:56.391966 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:56.392752 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:56.394470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:56.395427 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:56.396129 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:56.401385 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:56.406800 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:56.408769 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:56.409470 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.compute.server_external_events [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] Creating event network-vif-deleted:6c95ab61-8df9-4ec5-a1ad-4fd1a7ac6d9c for instance 19c28f5c-204f-49b4-8b24-8630fce690f6 on hv-cinder-85697 Oct 15 09:25:56.410936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:56.411293 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:56.411776 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:56.417090 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [req-1be91f63-4a4d-4f9a-a4f2-c22beddad4f2 req-8b80bb33-86b0-4460-bb3f-be0f9d0bd88f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042496 Oct 15 09:25:56.420240 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1124/2242] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:25:56.490757 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:25:56.498605 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-24a48f36-e338-4a25-8c7c-b02edddcfdf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 200 len: 1509 microversion: 2.1 time: 0.110613 Oct 15 09:25:56.499265 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1119/2243] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:56 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 1509 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:25:57.523041 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:57.523681 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:57.529839 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:57.530317 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:57.530753 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:57.531435 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:57.531887 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:57.532875 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:57.545835 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.wsgi [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] HTTP exception thrown: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Request method failure captured: Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: request: GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 HTTP/1.1 Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept: application/json Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Accept-Encoding: identity Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Connection: close Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Length: 0 Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Content-Type: application/json Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Host: 10.222.0.30 Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Openstack-System-Scope: None Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: User-Agent: python-urllib3/1.26.12 Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Auth-Token: gAAAAABjSnwFmmeduq_oB8ZA2sVXm_wOoiq5pf8Cgt6RH62aYN6jT_eNFUu4s8aVyUqxQqoRNqxoFT05wMARPnikW4LwqJDb9Wlyv9Nq0ZKC1HhbAfMO0EKzf4Tacoo5w_D01WctMa8dkgkQEqzz1dEyDZBsNaoasuoK-4jW2hHYfFFdp312QMc Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Id: None Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Domain-Name: None Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Identity-Status: Confirmed Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Is-Admin-Project: True Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Id: default Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Domain-Name: Default Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Id: c6262387226346b7a736e34171afb4de Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Project-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Role: member,reader Oct 15 09:25:57.547406 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Roles: member,reader Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c6262387226346b7a736e34171afb4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c6262387226346b7a736e34171afb4de", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Id: c6262387226346b7a736e34171afb4de Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-Tenant-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Id: default Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Domain-Name: Default Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Id: 04b8dc0532de441db59bd4fe465a8c0a Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: X-User-Name: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: method: > Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: exception: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:25:57.549476 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: action_args: {'id': '19c28f5c-204f-49b4-8b24-8630fce690f6'} Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:25:57.550302 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:25:57.551760 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR nova.api.openstack.wsgi Oct 15 09:25:57.553040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Returning 404 to user: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. {{(pid=125327) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:25:57.553040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b38ace8f-4793-4de4-8228-9ed0ff246e36 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 404 len: 111 microversion: 2.1 time: 0.031053 Oct 15 09:25:57.553040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1125/2244] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:57 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:25:57.642177 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1829123706", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1090915854", "security_groups": [{"name": "tempest-secgroup-smoke-248103280"}], "block_device_mapping_v2": [{"uuid": "03f2d619-848e-48cd-8359-505a0e8fc73e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccfbd7a-0c01-414f-bb39-7396d65ae598"}]}} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:25:57.752576 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.network.neutron [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] validate_networks() for [('9ccfbd7a-0c01-414f-bb39-7396d65ae598', None, None, None, None, None)] {{(pid=125329) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:25:58.155994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Flavor limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 15 09:25:58.156409 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Image limits 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 15 09:25:58.156938 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Flavor pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 15 09:25:58.157369 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Image pref 0:0:0 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 15 09:25:58.157809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.virt.hardware [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125329) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 15 09:25:58.166727 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:58.167212 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:58.167649 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:58.168406 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:58.168860 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:58.169282 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:58.185953 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for project c6262387226346b7a736e34171afb4de. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 15 09:25:58.190312 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.quota [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Getting quotas for user 04b8dc0532de441db59bd4fe465a8c0a and project c6262387226346b7a736e34171afb4de. Resources: {'ram', 'instances', 'cores'} {{(pid=125329) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 15 09:25:58.245706 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Going to run 1 instances... {{(pid=125329) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 15 09:25:58.247813 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='03f2d619-848e-48cd-8359-505a0e8fc73e',volume_size=None,volume_type=None)] {{(pid=125329) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 15 09:25:58.375400 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3df2b874-0688-4459-ab8b-326c29d702d7 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.736897 Oct 15 09:25:58.376476 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1120/2245] 10.222.0.30 () {60 vars in 1147 bytes} [Sat Oct 15 09:25:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 15 09:25:58.387718 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-449138a0-4104-4ee0-906b-cfcb6df0105f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:58.388362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-449138a0-4104-4ee0-906b-cfcb6df0105f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:58.442864 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-449138a0-4104-4ee0-906b-cfcb6df0105f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:25:58.449793 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-449138a0-4104-4ee0-906b-cfcb6df0105f tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1095 microversion: 2.1 time: 0.065886 Oct 15 09:25:58.450352 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1126/2246] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:58 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:25:59.473362 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:25:59.474023 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:25:59.482380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:59.482380 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:59.482759 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:59.483538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:25:59.484076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:25:59.484505 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:25:59.549827 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:25:59.558046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-c829ae23-edbd-469e-a729-4f0e692d04f0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1211 microversion: 2.1 time: 0.089442 Oct 15 09:25:59.558705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1121/2247] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:25:59 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:00.581070 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:00.581694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:00.589659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:00.590792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:00.591287 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:00.592249 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:00.592705 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:00.593377 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:00.684591 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c827be-0a76-4b72-9724-3f20b6b5dd09", "tag": "2bdbf9bb-2ad9-4e89-9584-35686861038f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:26:00.703459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:00.704925 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:00.705793 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:00.721812 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] Creating event network-changed:2bdbf9bb-2ad9-4e89-9584-35686861038f for instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 on hv-cinder-85697 Oct 15 09:26:00.727011 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-9cb69c7d-f170-4f94-8653-33ed4b02dc3a req-4bb080a8-59ed-4182-a6ca-b948962b9736 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045975 Oct 15 09:26:00.727619 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1122/2248] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:26:00.737275 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:00.745013 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-e3a1d251-5bec-4de5-8672-a131ce195189 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.168407 Oct 15 09:26:00.745565 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1127/2249] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:00 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:01.769954 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:01.770666 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:01.776737 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:01.777228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:01.777653 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:01.778366 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:01.778824 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:01.779278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:01.909968 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:01.917718 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-17cae3d0-c509-4ffb-8cef-48d962a3a194 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.153123 Oct 15 09:26:01.918290 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1123/2250] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:01 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:02.940392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:02.940995 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:02.947321 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:02.947794 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:02.948218 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:02.948897 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:02.949341 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:02.949802 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:03.076360 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:03.084537 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-ac2e176e-1bdd-495a-a2f5-e629bae5cfe5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.147959 Oct 15 09:26:03.085085 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1128/2251] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:02 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:04.107451 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:04.108062 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:04.115090 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:04.115565 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:04.115998 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:04.116677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:04.117125 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:04.117543 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:04.246655 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:04.254311 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-24adef69-34e8-40bf-a2fb-7209515b8d88 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.150741 Oct 15 09:26:04.254873 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1124/2252] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:04 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:05.276371 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:05.276985 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:05.283443 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:05.283918 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:05.284403 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:05.285126 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:05.285580 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:05.286030 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:05.413496 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:05.421040 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-2959dde8-95dc-4a5f-8e01-281b9f0e1617 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.148601 Oct 15 09:26:05.421584 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1129/2253] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:05 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:06.444577 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:06.445237 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:06.451761 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:06.452247 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:06.452686 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:06.453376 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:06.453870 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:06.454297 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:06.584463 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:06.592120 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-dfb4e7d0-8864-4df1-99c1-42b54d0550ed tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.151882 Oct 15 09:26:06.592684 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1125/2254] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:06 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:07.615125 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:07.615726 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:07.621590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:07.622092 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:07.622518 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:07.623189 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:07.623633 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:07.624049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:07.750625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:07.758845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-84122b17-13ca-4699-b5d3-2f0b4c98994e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.147714 Oct 15 09:26:07.759407 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1130/2255] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:07 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:08.782007 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:08.782623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:08.785717 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=2 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:26:08.786429 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell0:SELECT=6 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:26:08.797462 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:08.797992 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:08.798423 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:08.799112 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:08.799569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:08.799987 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:08.927216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:08.935135 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-f4134dd4-ba86-4d9e-82a8-40367b3dbbd5 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.157292 Oct 15 09:26:08.935691 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1126/2256] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:08 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:09.957242 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:09.957869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:09.959829 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell0:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:26:09.965362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:09.965870 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:09.966300 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:09.966974 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:09.967426 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:09.967837 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:10.098590 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:10.106362 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-b064c98a-6356-44fb-9a0c-f1f520475c9e tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.153005 Oct 15 09:26:10.106939 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1131/2257] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:09 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:10.700389 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c827be-0a76-4b72-9724-3f20b6b5dd09", "name": "network-vif-plugged", "status": "completed", "tag": "2bdbf9bb-2ad9-4e89-9584-35686861038f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:26:10.710985 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:10.711474 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:10.711903 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:10.723714 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] Creating event network-vif-plugged:2bdbf9bb-2ad9-4e89-9584-35686861038f for instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 on hv-cinder-85697 Oct 15 09:26:10.728606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-61cd00a3-f4df-4c7d-b4ab-f6b0e3bdd848 req-9c119fe1-4bc4-43ae-9db0-b9e1d12ad1c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Oct 15 09:26:10.729201 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1127/2258] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:26:11.128411 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:11.129665 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:11.136197 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:11.136673 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:11.137102 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:11.137821 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:11.138272 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:11.138702 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:11.264845 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:11.273063 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-3b105cf3-e34b-4c86-aae7-d03c0a1dcbf0 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1266 microversion: 2.1 time: 0.148444 Oct 15 09:26:11.273625 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1132/2259] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:11 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:12.296756 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:12.297459 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:12.304527 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:12.305013 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:12.305448 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:12.306168 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:12.306623 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:12.307051 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:12.439994 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:12.447975 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-1c4608db-c694-432a-a77c-3d5017b274d9 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1453 microversion: 2.1 time: 0.155854 Oct 15 09:26:12.448552 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1128/2260] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:12 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:26:12.469747 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:26:12.470359 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.compute.api [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125327) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:26:12.477258 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:12.477769 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:12.478203 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:12.478890 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:12.479342 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:12.479763 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG oslo_concurrency.lockutils [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125327) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:12.608010 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.policy [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125327) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:26:12.616243 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO nova.api.openstack.requestlog [None req-014695ff-fe6b-489b-9e6b-893e0d34d73d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1453 microversion: 2.1 time: 0.150366 Oct 15 09:26:12.616792 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: [pid: 125327|app: 0|req: 1133/2261] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:26:12 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:26:14.446016 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c827be-0a76-4b72-9724-3f20b6b5dd09", "tag": "2bdbf9bb-2ad9-4e89-9584-35686861038f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:26:14.455417 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:26:14.455901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:26:14.456334 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:26:14.470260 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] Creating event network-changed:2bdbf9bb-2ad9-4e89-9584-35686861038f for instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 on hv-cinder-85697 Oct 15 09:26:14.475958 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-18330f88-20ac-447d-96cd-c58cfaee4297 req-b9d32f63-aded-43a5-a9fb-2ea3f2bad676 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094847 Oct 15 09:26:14.476585 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1129/2262] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:27:54.075392 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2275dc7f-5727-4791-a3e2-3d9bf4607541] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 15 09:27:54.075946 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=24 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:27:54.076682 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_cell1:SELECT=52 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:27:54.081383 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.api.openstack.wsgi [None req-f5cdc698-f2d6-4e8c-aed9-42c8c8321b42 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-760529833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1090915854", "security_groups": [{"name": "tempest-secgroup-smoke-248103280"}], "block_device_mapping_v2": [{"uuid": "8c03c9ce-328d-4282-94ac-9b7282ccf073", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9ccfbd7a-0c01-414f-bb39-7396d65ae598"}]}} {{(pid=125327) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:27:54.192659 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG nova.network.neutron [None req-f5cdc698-f2d6-4e8c-aed9-42c8c8321b42 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] validate_networks() for [('9ccfbd7a-0c01-414f-bb39-7396d65ae598', None, None, None, None, None)] {{(pid=125327) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 15 09:27:55.083168 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] [2275dc7f-5727-4791-a3e2-3d9bf4607541] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60786. Oct 15 09:28:04.095357 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: DEBUG dbcounter [-] [125327] Writing DB stats nova_api:SELECT=2 {{(pid=125327) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:28:57.306904 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8b36a50e-0270-4e32-8c64-cc741e9e62cd] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 15 09:28:57.307809 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:28:57.308547 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG dbcounter [-] [125329] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 15 09:28:57.309648 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:28:57.309901 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 (ip 10.222.0.30) !!! Oct 15 09:28:57.311461 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:28:57.311580 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 (ip 10.222.0.30) !!! Oct 15 09:28:57.312709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 15 09:28:57.312815 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Sat Oct 15 09:28:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 (ip 10.222.0.30) !!! Oct 15 09:28:57.319320 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:28:57.319913 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:28:57.332291 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:57.332780 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:57.333216 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:57.333936 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:57.334393 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:57.334816 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:57.362712 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Going to try to terminate instance {{(pid=125329) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 15 09:28:57.444113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3c9b4433-7a98-4a15-b420-05d88cd629eb tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 204 len: 0 microversion: 2.1 time: 0.138642 Oct 15 09:28:57.445415 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1130/2263] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:28:57 2022] DELETE /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 15 09:28:57.451364 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5c827be-0a76-4b72-9724-3f20b6b5dd09", "tag": "2bdbf9bb-2ad9-4e89-9584-35686861038f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:28:57.460850 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:57.461333 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:57.461798 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:57.472863 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] Creating event network-changed:2bdbf9bb-2ad9-4e89-9584-35686861038f for instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 on hv-cinder-85697 Oct 15 09:28:57.477645 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-bc5ec49d-85ca-4ee0-a4a1-1034a07be1f0 req-1d34211a-4da7-4f78-bcea-cfaec62dc9f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030859 Oct 15 09:28:57.478278 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1131/2264] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 15 09:28:57.483228 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:28:57.483930 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:28:57.490709 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:57.491202 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:57.491677 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:57.492546 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:57.493005 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:57.493433 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:57.626048 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:28:57.633883 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-fa423979-4e7e-4042-9029-37d6d0921c0d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1577 microversion: 2.1 time: 0.154480 Oct 15 09:28:57.634453 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1132/2265] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:28:57 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 15 09:28:58.656542 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:28:58.657185 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:28:58.670187 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:58.670682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:58.671119 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:58.671820 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:58.672276 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:58.672705 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:58.674359 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO oslo.messaging._drivers.impl_rabbit [-] [8b36a50e-0270-4e32-8c64-cc741e9e62cd] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 60832. Oct 15 09:28:58.809422 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:28:58.817103 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-6c85c72c-429c-425d-97ae-a96a95a2882d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1577 microversion: 2.1 time: 0.164584 Oct 15 09:28:58.817687 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1133/2266] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:28:58 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:28:59.492356 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5c827be-0a76-4b72-9724-3f20b6b5dd09", "name": "network-vif-deleted", "tag": "2bdbf9bb-2ad9-4e89-9584-35686861038f"}]} {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 15 09:28:59.501531 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:59.502033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:59.502455 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:59.513410 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.compute.server_external_events [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] Creating event network-vif-deleted:2bdbf9bb-2ad9-4e89-9584-35686861038f for instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 on hv-cinder-85697 Oct 15 09:28:59.519361 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [req-68917f6f-488c-4a1b-94b6-168cfc5b5e67 req-00a27563-b467-494b-b1a0-1b74831459c2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030176 Oct 15 09:28:59.519946 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1134/2267] 10.222.0.30 () {64 vars in 1317 bytes} [Sat Oct 15 09:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 15 09:28:59.840001 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:28:59.840830 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:28:59.847475 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:59.847957 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:59.848392 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:59.849080 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:59.849536 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:59.849990 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:59.879682 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:28:59.880155 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:28:59.880597 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:28:59.881026 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.objects.instance [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lazy-loading 'fault' on Instance uuid f5c827be-0a76-4b72-9724-3f20b6b5dd09 {{(pid=125329) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 15 09:28:59.924566 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.policy [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04b8dc0532de441db59bd4fe465a8c0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6262387226346b7a736e34171afb4de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125329) authorize /opt/stack/nova/nova/policy.py:199}} Oct 15 09:28:59.933117 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-5af0ad03-de22-4da7-b928-ee6624a256df tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 200 len: 1231 microversion: 2.1 time: 0.096457 Oct 15 09:28:59.939245 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1135/2268] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:28:59 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 15 09:29:00.956032 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:29:00.956734 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: f5c827be-0a76-4b72-9724-3f20b6b5dd09] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:29:00.963058 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:00.963539 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:00.963971 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:00.964660 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:00.965732 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:00.966160 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:00.981348 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] HTTP exception thrown: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Request method failure captured: Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 HTTP/1.1 Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnwFmmeduq_oB8ZA2sVXm_wOoiq5pf8Cgt6RH62aYN6jT_eNFUu4s8aVyUqxQqoRNqxoFT05wMARPnikW4LwqJDb9Wlyv9Nq0ZKC1HhbAfMO0EKzf4Tacoo5w_D01WctMa8dkgkQEqzz1dEyDZBsNaoasuoK-4jW2hHYfFFdp312QMc Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:29:00.982979 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c6262387226346b7a736e34171afb4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c6262387226346b7a736e34171afb4de", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 04b8dc0532de441db59bd4fe465a8c0a Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. Oct 15 09:29:00.984514 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': 'f5c827be-0a76-4b72-9724-3f20b6b5dd09'} Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:29:00.985608 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. Oct 15 09:29:00.987199 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:00.988596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Returning 404 to user: Instance f5c827be-0a76-4b72-9724-3f20b6b5dd09 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:29:00.988596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-3d8e84e5-10d7-40fc-8e83-be0eef97d9e6 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09" status: 404 len: 111 microversion: 2.1 time: 0.032201 Oct 15 09:29:00.988596 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1136/2269] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:29:00 2022] GET /compute/v2.1/servers/f5c827be-0a76-4b72-9724-3f20b6b5dd09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:29:01.442046 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:29:01.442538 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:29:01.448347 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:01.448821 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:01.449252 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:01.450033 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:01.450980 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:01.451399 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:01.464508 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] HTTP exception thrown: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Request method failure captured: Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: DELETE /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 HTTP/1.1 Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnwFmmeduq_oB8ZA2sVXm_wOoiq5pf8Cgt6RH62aYN6jT_eNFUu4s8aVyUqxQqoRNqxoFT05wMARPnikW4LwqJDb9Wlyv9Nq0ZKC1HhbAfMO0EKzf4Tacoo5w_D01WctMa8dkgkQEqzz1dEyDZBsNaoasuoK-4jW2hHYfFFdp312QMc Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:29:01.466098 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c6262387226346b7a736e34171afb4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c6262387226346b7a736e34171afb4de", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 04b8dc0532de441db59bd4fe465a8c0a Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.467606 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '19c28f5c-204f-49b4-8b24-8630fce690f6'} Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:29:01.468493 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.469822 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.471076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Returning 404 to user: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:29:01.471076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-b891ea90-7eb7-4cc1-97e6-6558d6dc0866 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "DELETE /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 404 len: 111 microversion: 2.1 time: 0.029205 Oct 15 09:29:01.471076 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1137/2270] 10.222.0.30 () {58 vars in 1239 bytes} [Sat Oct 15 09:29:01 2022] DELETE /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 15 09:29:01.475518 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:29:01.476113 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.compute.api [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] [instance: 19c28f5c-204f-49b4-8b24-8630fce690f6] Fetching instance by UUID {{(pid=125329) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 15 09:29:01.482116 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:01.482595 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:01.483024 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:01.483704 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Acquiring lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 15 09:29:01.484153 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 15 09:29:01.484569 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG oslo_concurrency.lockutils [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Lock "a0b25d10-5217-4459-9654-b7e7b9f4e0c0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125329) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 15 09:29:01.498635 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.wsgi [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] HTTP exception thrown: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Request method failure captured: Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: request: GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 HTTP/1.1 Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept: application/json Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Accept-Encoding: identity Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Connection: close Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Length: 0 Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Content-Type: application/json Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Host: 10.222.0.30 Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: Openstack-System-Scope: None Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: User-Agent: python-urllib3/1.26.12 Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Auth-Token: gAAAAABjSnwFmmeduq_oB8ZA2sVXm_wOoiq5pf8Cgt6RH62aYN6jT_eNFUu4s8aVyUqxQqoRNqxoFT05wMARPnikW4LwqJDb9Wlyv9Nq0ZKC1HhbAfMO0EKzf4Tacoo5w_D01WctMa8dkgkQEqzz1dEyDZBsNaoasuoK-4jW2hHYfFFdp312QMc Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Id: None Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Domain-Name: None Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Identity-Status: Confirmed Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Is-Admin-Project: True Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Id: default Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Domain-Name: Default Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Project-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Role: member,reader Oct 15 09:29:01.500148 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Roles: member,reader Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c6262387226346b7a736e34171afb4de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c6262387226346b7a736e34171afb4de"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c6262387226346b7a736e34171afb4de", "adminURL": "http://10.222.0.30:8080"}]}] Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Id: c6262387226346b7a736e34171afb4de Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-Tenant-Name: tempest-TestVolumeBootPattern-1079617022 Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Id: default Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Domain-Name: Default Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Id: 04b8dc0532de441db59bd4fe465a8c0a Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: X-User-Name: tempest-TestVolumeBootPattern-1079617022-project Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: method: > Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: exception: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.501668 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: action_args: {'id': '19c28f5c-204f-49b4-8b24-8630fce690f6'} Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 15 09:29:01.502579 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. Oct 15 09:29:01.503929 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: ERROR nova.api.openstack.wsgi Oct 15 09:29:01.505198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Returning 404 to user: Instance 19c28f5c-204f-49b4-8b24-8630fce690f6 could not be found. {{(pid=125329) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 15 09:29:01.505198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-33eea1d2-d1ee-4e31-ab50-d23368b94a8d tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6" status: 404 len: 111 microversion: 2.1 time: 0.029382 Oct 15 09:29:01.505198 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1138/2271] 10.222.0.30 () {58 vars in 1236 bytes} [Sat Oct 15 09:29:01 2022] GET /compute/v2.1/servers/19c28f5c-204f-49b4-8b24-8630fce690f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 15 09:29:02.797075 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: DEBUG nova.api.openstack.wsgi [None req-20118383-8210-457e-8a73-5bb00fb9df14 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] Calling method '.version_select at 0x7f575a9d5160>' {{(pid=125329) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 15 09:29:02.823862 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: INFO nova.api.openstack.requestlog [None req-20118383-8210-457e-8a73-5bb00fb9df14 tempest-TestVolumeBootPattern-1079617022 tempest-TestVolumeBootPattern-1079617022-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1090915854" status: 202 len: 0 microversion: 2.1 time: 0.030438 Oct 15 09:29:02.824427 dv-cinder-856971-3-iscsi devstack@n-api.service[125329]: [pid: 125329|app: 0|req: 1139/2272] 10.222.0.30 () {58 vars in 1263 bytes} [Sat Oct 15 09:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1090915854 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 15 09:29:34.092869 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:29:34.094073 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:29:34.094971 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:29:34.095144 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:29:34.096694 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:29:34.096840 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:29:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:32:54.115610 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:32:54.116285 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:32:54.116901 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:32:54.117015 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Oct 15 09:32:54.117940 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 15 09:32:54.118049 dv-cinder-856971-3-iscsi devstack@n-api.service[125327]: Sat Oct 15 09:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!!